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PREFACE TO PART II 


If it be not thought bad form to preface a volume with au 
apology, I should like to ask the indulgence of those of my 
readers who have been so complimentary as to express to the 
publishers and to me their irritation at this delay of two years 
or more in the completion of the revised second edition of the 
Manual. The truth is, that the unexpected exhaustion of the 
first edition of the book found me quite unpiepared to rewrite 
the text at short notice, and that the whole subject of mental 
tests had meanwhile so expanded as to present a task of no 
small magnitude.to one who would seek to deal at all adequately 
with the material that had become available. 

In this, volume, then, as in Part I, the text has undergone 
extensive revision and alteration. In a number of instances 
the addition of new materials, of new methods and of new re- 
sults has been sufficient to alter the complexion of the tests so 
decidedly as to amount to entirely new presen tat ions«^of the 
topics with which they deal. The Kent-Rosanolf Test and the 
Analogies Test are introduced as totally new material. 

On the other hand, I have been compelled, reluctantly, for 
reasons set forth in the text, to omit consideration of serial 
graded tests (Chapter XIII). This omission I hope to repair 
later on by publishing a supplementaryi volume dealing with 
Systems of Tests in general. To incorporate this material in 
the present volume would increase its size unduly and delay 
its appearance beyond reasonable limits of time. 

In addition to the acknowledgments for assistance made in 
the preface to Part I, my thanks are extended to Miss Margaret 
Cobb and Dr. H. 0. Rugg for valuable assistance in the reading 
of proof. Other special acknowledgments I have tried to 
make in the course of the text. 

G. M. W. 

University of Illinois, April, 1915. 
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PART II 


COMPLEX PROCESSES 
CHAPTER VIII 
Tests of Description and Report 

The two tests which are described in this chapter hane certain 
features in common which demarcate them, on the one hand 
from the tests of perception and attention of the previous chap* 
ter, and on the other hand frpm the memorj^ tests of the succeed- 
ing chapter, though, in many respects, they resemble these tests. 

The essential idea in both of the present tests is to determine 
capacity, not merely to attend and observe, or to recall what has 
been observed, but to put the results of this observation into 
linguistic form. If the observer gives his account of the ex})eri- 
ence at the time of his observation, this constitutes description ; 
if at some time subsequent to his observation, this constitutes 
report. 

It is evident that this giving of an account of an experience, 
particularly if the experience be somewhat complicated in form, 
is a more complex psychical process than those under discussion 
in the tests of attention and perception? This greater com- 
plexity makes the reduction of the observer’s performance to 
exact quantitative terms a matter of greater difficulty, but, on 
the other hand, the activiiy called forth is more akin to that 
demanded in everyday life, and it is for this reason that these 
tests have been felt to possess a peculiar value, particularly in 
the study of individual differences in mental constitution and 
mental efficiency. Again, language occupies so strikingly promi- 
nent a place in our mental economy that tests which seek to 
bring out the observer’s ability to cast experience into linguistic 
form are, on that account, well worth while. This is particn- 

[ 375 ] 9 
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larly the case in the second form of test, that of the report, 
wliirli, in connection with the ‘^psychology of testimony,” has of 
late had a prominent place in psychological research. 

TEST 31 

Descriplion of an object. — The descripti»>n test first came into 
prominence through the Av ork of Binct, who urged that the study 
of individual psychology may be best advanced by resort to the 
experiniSital examination of complex, rather than of simple 
mental y)i*ocesses, and who considered the description tCvSt of 
special value in this connection. Binet made preliminary tests 
with Henri in 1893 (3), and wwked at the test later by biniself 
(1, 2). His method has been folloAved, though not in exact de- 
tail, by LeCiere (7), Sharp (0), Monroe (8), and Cohn and 
Dieffenbacher (5). 

Materials. — Cigarette. Cancelled 2-cent postage stamp. 

Lithograph, entitled “Hindoos.” 

The cniicellt'ct stamp w^as usc^d by Monroe, the cigarette by Binet. The 
iniiograpli is substituted for the diftcront pictures that have been used by 
other investigators (Binet and Ilonri used Neuvi lie’s “The Last Cart- 
ridge,” Bi.iiet a picture representing Fontaine's *’Le Laboreur et ses En- 
fants,'’ Aiiss Sharp “Tlie Golden Wedding” and “The Interrupted Duel”), 
because of the impossibility of securing these particular pictures, or of the 
diiliculty of using them under the conditions that prevailed in the original 
experiments (Binot's school children were wxll acquainted with the fable 
frojn Fontaine, for example). 

If It is desired to extend the list of materials, E may employ other 
objects used by Binet (2), such as a box of matches, a penny, a leaf, etc. 

For group tests, there should be at least one picture for every 5 S'b, one 
cigarette for every 2 and a stamp for each 8, 

For group tests, it would be desirable to secure a set of stamps whose 
cancellation marks were approximately the same. The stamps should be 
trimmed off in such a manner as to show the full border of the stamp and 
a narrow margin of the paper upon which It was attached. 

The lithograph is one of a series called Leutemann’s Types of Nations, 
catalogued by E. Steiger & Co., New York. It may be purchased, like all 
other material cited In this book, of C. H. Stoeltlng Co., Chicago, III. 


Method. — (1) For the picture-test, supply S with writing 
materials ; place the lithograph upright before him, about 75 cm. 
distant. Instruct him : “Write a description of this picture so 
that one who had never seen it would know all about it.” Allow 
10 mlu. 
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(2) For the cigarette-test, give the following instructions, 
and no others : ‘I’m going to put on this table before you a 
small object. I shall leave it there under your eyes. I want you 
to write a description of it; not to draw it, but describe it in 
words. You will have about 5 min. Here is the object.” If S 
is busy at the end of the allotted time, or has written but a few 
lines, the time may be slightly extended. 

(3) For the stamp-test, proceed in a similar manner, save 
that ^’s are not forbidden to draw the stamp, if they, wish to. 
The instructions may run: ‘‘Describe this postage stamp so 
that a person who had never seen one would know all about it.” 
Allow 10 min., or more if needed. 

Variations of Method. — The problem of assigning an appro 
priate title to a picture or of asking appropriate questions con- 
cerning it may be regarded as a variation of the description test. 
For suggestions as to this test see below, under Notes. 

For young children, and, indeed, for older ones under many 
conditions, it is better that E should write from S’s dictation, 
perhaps stenographically. 

Treatment of Data. — In general, the results of the descrip- 
tion test are not intended, to be submitted to exact quantitative 
treatment, but are to be inspected for the purpose of forming an 
opinion of general mental type and capacity. The papers 
may, however, be treated quantitatively, l)y (1) counting the 
number of words written, or (2) counting the number of lines 
written. E may, further (3), record in general terms the readi- 
ness and ease with which S undertakes the description, and (4) 
may rate his paper as a whole, with respect to its comparative 
merit, on a score of 10 for a satisfactory or adequate description. 
(5)^ The description may, perhaps, be classified also with respect 
to its general type or character, following the classification 
adopted by Binet, Le Clqre, and others as explained below. (6) 
It is possible, following Cohn and Dieffenbacher, to score de- 
scriptions more formally and precisely after the manner pro- 
posed for reports (Test 32). (7) Descriptions of the postage 
stamp may also be catalogued with respect to the items men- 
tioned, as was done by Monroe. 
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Results. — (1) The description of an object is inadequate, 
because it is almost invariably simplifiedy i. c., a considerable 
number of its features, even important features, are unraen- 
tioned. Thus, in one of Binet’s photographs, of the 22 objects or 
features that were mentioned at all, only 9.4 were mentioned, on 
the average, in each description. 

(2) This simplification or reduction in the description is the 
result of what might be termed a process of selection. Certain 
features are mentioned in practically all descriptions, others are 
mentioned only occasionally. By tabulating the number of 1 imes 
each feature is mentioned, one may discover some of the princi- 
ples which condition this selective process. Thus, in Binet’s 
picture of the ^‘Laborer, the old man is mentioned 36 times, his 
sons 30, his bed 29, the seated woman 27, etc., until we come to 
relatively unimportant objects that may almost escape mention 
at all, 6. g.y a stick in the hands of one of the children — only 4 
times in 36 descriptions. When pictures are used, persons are 
more often mentioned than furniture or other details of the set- 
ting of the scene. 

Similarly, in the stamp-test, tabulation indicates, according 
to Monroe, the following order of frequency of mention: (1) 
word-inscriptions, (2) color, (3) number-inscriptions," (4) por- 
trait, (5) substance, (6) form, (7) use, (8) perforated edge, (9) 
size, (10) cancellation, (11) ornamentations. The item use de- 
clines with age: all others are mentioned more frequently as 
age increases. 

(3) Dependence on sex. Monroe states that girls generally 
mention more items than boys, and ^^seem to surpass boys in 
their knowledge of the postage stamp.*^ It is not clear, however, 
whether this seeming superiority is due to better observation, to 
greater industry or to greater zeal and conscientiousness. Cohn 
and Dieffenbacher similarly find the descriptions by girls more 
comprehensive than those by boys. 

(4) Dependence on age. Cohn and Dieffenbacher tested 
school children 7 to 20 years of age with a colored picture (^Puss 
in Boots’). There was no clear augmentation of the range of 
description after 10.5 years in the case of the boys. At the age 
of 8, the description is predominantly an enumeration of objects, 
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though not a single color was mentioned by boys of that age. 
Esthetic and interpretative features are rarely noted before the 
IGth year, when a reflective element is first apparent. Increase 
of age is characterized. by an increase in organization and sys- 
tematization of the descriptions. Actual errors are relatively 
uncommon : the few that are met with [fidelity is 97.2 per cent, 
among boys, 98.7 per cent, among girls) ai.,i often verbal mis- 
takes, the remainder true errors of apprehension. 

(5) Individual differences. In 150 accounts of the photo- 
graph, Binet found no two alike. This wealth of individuality 
makes the description-test at once valuable and difficult — valu- 
able as an indication of the variety of mental constitution, diffi- 
cult as to quantitative or comparative treatment. As an extreme 
illustration, one may contrast the following descriptions of a 
postage-stamp — the first by a girl of 8, the second by a boy of 16. 

(a) “The i)ostage stamp has a picture in it. The postage stamp costs 
two cents. It says united states postage on it. The man has hair braided 
in back of his head. The Boarder is round. It has arms on it. The shape 
is square. The color is red. The man is White. You can get these to the 
postice [post-office] for two cents. There are lines around the boarder. 
The back of the stamp is. white. It has nomber 2 on each side of it. The 
man has Ipng halr.“ 


ib) “comments on the accompanying U. 8. or AMEBICA 2 CENT POSTAGE 

STAMP. 

Its meaning: The Postage stamps have glorious history. In the 
past .M years they have been more and more useful until now they are not 
only absolutely necessary, but constitute one of the great helps in the study 
of Geography, and one of the noblest pleasures for thousands and millions 
of people ; Kings and Queens as well as children in the most miserable 
social condition. 

“2. This Postage Stamp has the red color and is now next to the one 
pqnny stamps of Great Britain the most extensively used stamp used in 
the world. If I am not wrong its circulation in the past and present is the 
next largest of all others. The one penny stamp, I think has the first 
place. 

“3, Its surroundings are very interesting. It is mounted on a piece of 
paper, remainder of an envelope, which fact easily -indicates that it Is used 

Jn the most cases for letter correspondence. I notice [Continues 

In this and the fourth paragraph a description of the stamp itself.] 

5. Some particular observations. l had 500-600 of them at home 
Which my couSiu had the kludues.s to send me. Of course they are of no 
special value but yet they teach my little brothers the Important lesson 
that such a little thing, like a stamp, will do all the ncicessary things for 
the transportation of a letter or other mall matter from the Atlantic to 
the Pacific. It is very interesting to me that with the march of civlllza- 
tlOU the great Postal system of the World has increased Its actions more 
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and more until It Is now one of the chief fnnotlons under the eun. How 
much this single stamp has done I cannot say, but I know that some 
stamps, precisely like this, have done groat service to the country/' 

(G) Types. Notwithstanding this diversity, investigators 
have sought to classify descriptions into a limited number of 
types. Thus, Binet proposes four types — the descriptive, the 
observational, the emotional (poetic, imaginative), and the 
erudite — each present in varying shades and degrees. 

(а) The describer, or enumerator, as one might term him, merely cata- 
logs the features of the object before him, with little regard for their 
interrelations, or for the meaning of the object as a whole. 

Example : “The cigarette has the general form of a cylinder, cut at one 
end by an Inclined plane where the paper is folded. It is stuffed with a 
rather dark brown tobacco. The paper Is striped lengthwise. The paper 
is somewhat bruised. The tobacco projects about 0.5 centimeter from one 
end." 

(б) The observer^ though not necessarily more Intelligent or clever than 
the clescriber, places more emphasis upon the interrelations of the several 
features that he mentions, interprets what he sees, conjectures and indi- 
cates the significance of the object as a whole. This type is also men- 
tioned by '^Irs. Bryant in her ‘descrlption-of-a-room’ test (4). 

Example : “A long, white, round object, composed of a paper cylinder, 
about ^ or % centimeter in diameter, filled with what is probably 
Oriental tobacco. It is about 7 centimeters long and must weigh about C 
grams f really 2 g. j. It is a badly rolled, uneven cigarette, and has been 
handled since it was pasted. In two places, to the right and left of the 
middle, the paper shows streaks as if it had been twisted. Other hori- 
zontal depressions indicate that there has been some pressure exerted 
upon the cigarette. I don’t see the line where It has been stuck, but It 
must be badly fastened.” 

(c) Tlie emotional, imaginative, or poetic 8 Is less accurate in observa- 
tion, but introduces emotion, sentiment or imaginative interpretation In 
his description; 

Example: “It is a cigarette. It is thin, long, somewhat wrinkled. Its 
shape suggests a kind of elegant ease. Is It the cigarette itself or the 
memories that it awakes that remind me somehow of a scape-grace? The 
cigarette, there, all by itself on the table, makes me think of the bad 
student that goes off in the corner by himself to smoke. But I must write 
about the cigarette itself, and banish the Idea of the smoker,” etc. 

(d) The erudite 8 .tells what he knows, what he has been taught, or 
Interjects bits of personal information about the object This may Indi- 
cate the presence of an unusual fund of information, or It may Indicate 
sheer laziness, In that it is often easier to write what one knows than 
actually to describe from direct inspection. 

Example : “We have before us here a cigarette. Let us see how it is 
made. In the first place, the exterior envelope is of light paper, called 
ijllk-paper. Then, inside is the tobacco. Tobacco is a product that grows 
almost everywhere in warm or temperate, climates. The leaves of this 
shrub are gathered, and, after a treatment which lasts four years, are 
turned over to the public in the form of powder, that is, snuff, or in 
shreds, as in the present instance/' etc. 
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Miss Sharp did not attempt a classification Into types, but noted that 
S’s observation “may be primarily directed to the particular objects or 
details of the picture, to the general arrangement of the objects, that is, 
the composition of the picture, or to the meaning of the picture, the story 
which it conveys, — the details observed being such as lead up to this inter- 
pretation, or explain and apply the interpretation that is given first. The 
different ways in which the. same picture appeals to the various indi- 
viduals indicate differences in mental constitution/^ 

The results of LeCIere’s test are not directly comparable with those of 
other iii\esligiitors, because his instructions were not to describe the 
object (gold watch), but to “write something that comes into mind as you 
look at it.” He distinguishes in the contributions made by 30 girls, aged 
33 to 37 years, seven types, viz.: description, observation, imagimition, 
moral reflectioin erudition, pure or simple emotion, and esthetic emotion. 
He docs not find, however, that any one of his jS’s contributes a paper tliat 
may I'c classified in any one of these types, nor does any paper give evi- 
dciice of a 'complete luind,' in the sense that all seven of the types 
rcprcsoiitod therein. In general, older or relatively more intelligent cliil- 
drcMi write more varied or complex papers, i. c., approach the theoretically 
•eoin])lete’ type of mental constitution. 

Mention may be made here of the use of pictures iu the Binet-Simou 
■s^.ale with the simple question: “What do ypu see in that picture?" or 
“What is that picture about?" Credit is given the child according as his 
replies indicate mere enumeration or a comprehension of the total mean- 
ing of the scene depicted. Mile. Descoeudres (G) has extended the scoring 
of iliis form of description test by assigning scores to replies of diiferent 
qnn lilies and also by noting the number of ideas expressed. She gave a 
credit of 1 for simple enumeratiou, 2 if a phrase or sentonee was used aud 
3 if the replies showed interpretation of meaning. Ay)plication of three 
pictures (not those usbd by Binet) to 14 backward children showed that 
rank in quality correlated distinctly with rank in quantity and also with 
estimated intelligence (.84, P.E. .02). 


Notes. — The attempt to use the description-test for classifica- 
tion of into types of mental constitutioir is of obvious inter- 
est. The drawing, from such a classification, of Inferences as to 
the mental make-up of the is as obviously hazardous, for S 
may write his description in the vein that he thinks. is wanted 
by E. Tlius, Binet had reason to think that several that he 
had classed as poetic or emotional were actually, in their every- 
day life, of a very matter-of-fact and unsympathetic disposition. 
In general, the drawing of inferences from the work of /S»’s 
would become safer in proportion as the descriptions were in- 
creased in number and variety, i e., an Sf who wrote in an emo- 
tional vein in four descriptions of four different objects has, pre- 
sumably, a real emotional constitution. 

What may be regarded as a modification of the description 
test is the test employed by Squire (10), in which children of 
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various school grades were shown a series of 5 pictures and 
asked in each case (n) to supply an appropriate title to the pic 
ture, and ifi) to ask an ajipropriate question about the picture. 
The titles protfercd by tlio children- were classed under live 
rubrics: ^‘mere enumeration of objects, description of pictures, 
unification in terms of action of principal figures, superlu ial 
unification in terms of relation to principal object and coinplef<* 
comprehension evidencing imaginative insight/^ 

With regard to the first problem, Mrs. Squire concludes: (1) No six- 
year-old child can be expected completely to comprebend a situation i)rc- 
seiited piotorially. (2) Neither can a seVeu-year-old child be expe<'te(l to 
give an adequate title. (3) The eight-year-old children are inclined to 
interpret meaning in terms of action, and a few are able to give super- 
ficial titles. (4) In tbe ninth and tenth years the titles given are mostly 
descriptive, but put tersely, rather than in disjointed statements. (5) 
By the twelfth year the majority of the names given will imss for titles, 
though a large proportion still deal with superficial aspects. (0) There 
are many cases of complete CH>mprehension in the thirteenth year. 

With regard to the second problem, replies may be classe»l ns failures, 
irrelevant minor or essential. There are no failures after the eiglitli 
year, while tlie percentage of ‘essentiaP questions rises from G at ago 7 to 
58 at age 13. 

It is scarcely necessary to add that these conclusions obtain only for 
the particular pictures employed by Mrs. Squire, whose article should bo 
coJisulted by those who seek to repeat this form of test of comprehension. 
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TEST 32 

Fidelity of report (Passage test)-— Capacity to observe, or 
range of observation, may be tested by methods previously de- 
scribed (Tests 24 and 25) ; native retentiveness or capacity for 
recall may be tested by methods such as those that are described 
in subsequent sections ; -capacity to describe v hat is seen may be 
tested as has been indicated in Test 31, but there exists a type of 
activity, that of reporting a previous experience, which in a way 
combines these several activities, in that it demands both atten- 
tive observation, retention, recall, and an ability to marshal 
and formulate the items of experience in a verbal report {Aus- 
sage). In studying the ^psychology of testimony,* interest has 
been developed of late in the direct examination by experimental 
niethods of the capacity to report as such, and it has been found 
that reports may exhibit varying degrees of fidelity or reliability, 
more or less independently of the capacity that the reporter? 
possess to observe or to retain experience; in other words, 
reports, may contain discrepancies or inadequacies which are 
due, not only to misdirected attention, mal-observation and 
errors of memory, but also to lack of caution or of zeal for accu- 
rate statement, to scanty vocabulary, to injudicious phrase- 
ology, or, of course, to deliberate intent to mislead.^ 

Historically, the idea of subjecting capacity of report to test 
seems first to have been definitely proposed iJy Binet (3) . Since 

'It is true that no bard and fast line- can be drawn between the report- 
test and the test of rau^e of apprehension, or between it and the ordinary 
memory-test ; in the main, however, range of apprehension implies a brief 
exposure tV ]h)v/ed by simple enumeration of the objects seen, so that what 
is tested is capacity to grasp or observe, rather than capacity to retain or 
to formulate. And the stock memory-test measures the amount of mate- 
rial that can he reproduced ; in it the learning is usually by heart, and 
the reproduction is largely mechanical. In the report-test, the object is 
more complex, the time of scrutiny much longer than in the observation- 
test, while stress is placed as much upon quality as upon quantity of re- 
production, especially upon the fidelity of reproduction as conditioned 
by such personal factors as timidity, cautiousness, assurance, skill In 
verbal formulation, etc. Again, the typical memory-test comprises a 
direct verbal reproduction of verbal material, while the typical Aussuge 
test comprises a verbal presentation of material originally experienced 
as visual scenes (pictures, events, etc.), with or without some verbal 
features. Nevertheless, in the interrogation, the report-test does closely 
resemble an ordinary test of memory. 
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tho study of the psychology of testimony has found its most 
enthusiastic and active expositor in Stern, who has written an 
extensive monograph (31) on the subject, and in whose period 
icals (Bcitrage zur Psychologic der Aussagc and Zeits, f. angc- 
wcindtc Psy diologic) most of the work of subse()uent investi- 
gators has, directly or indirectly, appeared. The a])plicability 
of this line of work to many practical problems, particularly in 
the field of jurisprudence, is too obvious to need further com- 
ment. 

GENERAL METHODOLOGY OP THE REPORT-TEST 


1. Choice of material. Of the several types of material that 
have been elaborated for the study of the report, e. g., the picture- 
test, the event-test, the rumor-test, etc., the first mentioned has 
many advantages for our present purposes.^ Two types of pic- 
tnre-test are prescribed; the first closely patterned after that 
employed by Binet in his study of suggestibility in school chil- 
dren, the second more in accord with the stock picture-test, as 
developed by Stern, Borst, Wreschner, Lobsien, and others. 

2. Choice of eeposwe-time. For pictures, times ranging 
from 5 sec. to 7 min. have been used, though 45-60 sec. is most 
usual. The principle which has controlled the choice of expos- 
ure-time for the two tests that follow is to select such a period 
as will permit an average 8 to examine each detail of the object 
once. 


3. Choice of time-interval. For the sake of brevity, the in- 

structions that follow prescribe a report directly after the ex- 
posure. If circumstances permit, E will find it of interest to 
extend the interval to several minutes, or even hours or weeks, 
The effect of lengthening time-interval has not as yet been satis- 
factorily determiDed. i 

4. Choice of form of report. There are two distinct forms of 
report, (1) the ‘narrative’ {Bericht. recit) , (2) the ‘interroga- 
tory’ (T'erhdr of Stern, Priifung of Wreschner, interrogatoire of 


I or n discussion of these advantages, of the several methods in detail, 
of the chief results, .and for a general review of the whole field of I lie 
r«.vchology of testhnony, the reader is referred to an earlier discussion bv 
the a^hwr (34). Suggestions for "further tests will likewise be found 
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Borst, forgage de memoire or questionnaire of Binei ) The liar* 
rative is a free account, delivered by Sy either orally or in writing, 
without comment, question, or suggestion by E: the interroga- 
tory is a series of prearranged questions; the replies to these 
questions constitute the ^deposition’ {V i horsprodnlct) , The 
(onstituent parts of the narrative or the deposition may be 
termed ^statements’ or steins.’ Each form oi report has its ad- 
vantages and its disadvantages : both should be employed when- 
ever possible. 

5. Choice of form of interrogatory. An interrogatory is 
‘complete’ when its questions cover all features of the experience 
exhaustively, and are proimunded to all /Sf’s in the same order 
and manner : an interrogatory is ‘incomplete’ when its questions 
are restricted to such as refer only to those items not mentioned 
by S in his narrative. The interrogatories that follow are de- 
signed to be complete, but E may, by ai)propriate selection, con- 
vert them into the incomplete type. 

6. Choice of questions. The form of questioning very mate- 
rially affects deposition, particularly if the questions are of 
the type known as ‘leading’ or ‘suggestive’ questions. To some 
extent any question is suggestive, in so far as it implies that its 
recipient knows something. If we follow Stern, at least six 
types of questions may be framed, viz.: determinative, com- 
pletely disjunctive, incompletely disjunctive, expectative, im- 
plicative, and consecutive. 

A determinative question is one that is introduced by a pronomi or 
interrogative adverb, ond is the least suggestive form of question, c. g., 
“What color is the dog?” 

A completely disjunctive question is one that forces the reporter to 
choose between two specified alternatives, e. g., “Is there a dog in the 
piclure?” 

An incompletely disjunctive question is one that offers the reporter a 
choice between two alternatives, hut does not entirely preclude a third 
possibility, e. g., “Is the dog white or black In practise, for many re- 
porters, especially for children, this form is virtually completely dis.lunc- 
tive, since a certain amount of independence is demanded for the choice 
of the third possibility, r. r/., for the answer “The dog is brown.” 

An expectatire question is one that arouses a moderately strong sug- 

“The terminology of the rei>ort-experlment has developed In Germany 
and France. I have been obliged to coin English equivalents — a task not 
always easy because the foreign terms have not been chosen with special- 
care to secure consistency or to accord with legal phraseology. For this 
reason, the foreign equivalents are included here and elsewhere in the 
discussion. 
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gestion of tho answer, c. *'Was there not a dog in the picture?’' (ThH 
is the form used by Binet to induce moderate suggestion.) 

An implicative question is one that assumes or at least implies the 
presence of a feature that was not really present in tho experience, c. {/., 
“What color is the catV*’ In practise, it is clear that a determinative 
question might become implicative if the reporter had completely for- 
gotten the item to which it referred. (The implicative question was used 
by Binet to indme strong suggestion.) 

The consecutive question is any form of question that is used to augment 
a suggeston that has been developed by pi-evious questions. 

7. Choice of method of grading. Treatment of data. In 
general, the adeqiiac}' of a report depends both upon its quantity 
and its quality : quantity is nioasured by the number of ijems 
mentioned or the number of questions answered (in absolute or"* 
ill relative terms) and is referred to as the range of report 
{JJmfang, ctcnduc) ; quality is measured by the fidelity of the 
statements made, and is referred to as the accuracy of report 
(Trcdc, fideliie). 

We have also at our command useful indications of the posh 
tiveness or degree of assurance that S places in his report. Be- 
sides (1) complete uncertainty don’t know” or ^*1 have for- 
gotten”), we mny distinguish (2) hesitancy (“I think” or 
believe”), (3) positive statement or assurance of ordinary de- 
gree, and (4) attestation or attestable assurance, i. e., the high- 
est degree of assurance, as indicated by &’\s Avillingness to take 
his oath that the statement is correct. 

On tills basis, tlie data may he subjected to treatment for the 
computation of a number of ^coefiicients of report / by the aid of 
the following simple formulas: 

COEFFICTEXTS OF jRePORT 


Let P ” number of i)Ossible items, 

n ~ number of items reported (or replies made), 
c ™ number of items reported with certainty (in- 
cluding attestation), 

^The fourth forrmiia is used by many writers, in place of the fifth, fur 
accuracy of report ; as here indicated, however, the indeterminate cases 
(“I don’t know’'; are omitted from the denominator in computing accu- 
racy. 

Xext to range and accui-acy, tho most important coe/Bcient is probably 
warranted assurance (8th formula), as a high ratio indicates a good wit- 
ness. who reports a large .number of items both correctly and with assur- 
ance. 
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a = number of items whose correctness is attested 
under oath, 

n(N) = number of items reported in the narrative, 
n(D)= number of items reported in the deposition, 
n(r)= number of items that are rightly reported, 
c{r)^ number of items that are certain and right, 
a{r)— number of items that are attested and right, 
a{tv)— number of items that are attested and wrong 

Then 

( t) n=r. range of report, absolute ( Umfang^ ^tendue} . 

(2) n/P = range of report, relative, 

(3) n{N) /n(D)~ spontaneity of report, 

(4) n(r)/n range of knowledge {Umfang des Wissens, 

eiendue du savoir)^ 

(5) n{r)/c ~ aecuraey of report {Trcuc, fideliU), 

(G) cjn-^r. assurance (suhjcclice ^wlierJieity assurance) , 

(7) c(r)/c — reliability of assurance {Zuvcrldssigkeit der 

f) i e h e r h e i /, Sicherheitsherechfigung, 
fidclite de la certitude), 

(8) c(r)/n^ waiianted assurance {Sicherlieit der Person. 

assurance justifiee), 

(9) c(r)/n(r):= assured accuracy (Versidierte Richtigkeit, 

justesse certifiee), 

(TO) a/n ==: tendency to oath or attestable assurance 

(tendance au serment), 

(11) a(r)/n^ warranted tendency to oath (tendance au ser- 

ment vMdique), 

(12) a(w)/n— unwarranted tendency to oath (tendance au 

fau.T-tcmoignage ) , 

(13) a(r)/a = reliability of oath (fid^liU du serment). 

The deterni illation of P, and hence of relative range of report, is often 
beset with difficulty ; the most practical working rule is to rank as ‘one 
item’ auy Combination of features that forms a single natural working 
group» the details of which w’ould escape individual observation under 
ordinary conditions. Again, P may be taken as the number of separate 
items ineutioned by a competent 5? in describing the picture or test-object 
by direct observation. Or, as Hegge (18) proposes. P may be computed 
by adding all the specific items mentioned in the reports of any one of a 
number of 5’s. Obviously, the magnitude of P will tend to increase with 
the number of ;b’s imtil a point is reached beyond which additional reports 
fail to afPect it appreciably. 
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A similar dtfllculty arises in deciding what items and how many should 
be the subject of questions in the interrogatory. In general, the coeffi- 
cients computed will have value only for a given picture or event and 
only Avheu obtained by a given interrogatory, and the Interrogatory must 
be constructed empirically, on the basis of actual preliminary trials, never 
a priori. 

Although different errors unquestionably have different degrees of iju- 
portance (to fr.rget a man is more serious than to forget the color of his 
necktie), no satisfactory plan for arbitrarily ‘weighting’ different items 
has been devised. 

The psychologically best method of grading is unquestionably to classify 
the data statistically according to various categories — such as persons, 
objects, colors, sizes, etc. — and to compute range, accuracy, assurance and 
the other coefficients for each category separately. This will greatly in- 
crease the labor of quantitative treatment, but it will afford valuable 
insight into the qualitative conditions of report that could not otherwise 
be secured: the several coefficients can, for comparative purposes, be 
united subsequently into a single series of coefficients for the person or 
persons under consideration. 


A. REPOUT-TEST WITH BINET^S CARD OF OBJECTS 


Material. — Eectangular sheet of orange-yellow cardboara, 
33.5 X 40.5 cm., to which are attached two photograj)hs. a label, 
a button, a penny, and a postage stamp.® Watch. 

Method. — Hive S the following instructions: “I want to tr\ 
an experiment with you to see how good your memoiw is. I am 
going to shoAv you a large card with a number of things fastened 
on it. You will have just half a minute to look at it. Half a 
minute is a pretty short time, so you must look very' carefully, 
because afterwards I shall want you to tell me what you have 
seen, and I shall ask you questions about many little details, 
and I want you to answer these questions exactly, if you can. 
Do you understand ?” 

Place the card directly before <S' in a good light. At the eud of 
30 sec., remove it and keep it well concealed. Direct 8 at once ■ 
“Now tell mo everything you saw: describe it so clearly that if 
I had never seen the card 1 should know all about w^Jiat was on 
it.” The narrative is given orally by 8, and recorded verbatim 
by E, without comment, query, or suggestion. Reread the repoi-f 
to 8, and a.sk him to indicate what statements he is .so sure of 


These ob.lects are not exact duplicates of the Bluet group, and the t-.rd 
Is somewhat larger. The exposure-time and the questions of the inter 
rogatory have been correspondingly modified. on oi i ne inter 
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that he would swear to their accuracy. Underline these state- 
ments. 

Proceed next with the interrogatory, if possible, ask Sf the 
following questions in the order given.® Record his replies by 
number, verbatim, and underline all attested replies. 


Interrogatory for the card of objects. 


(1) Did you notice a coiii? 

(2) What kind of a coin is it? (What denomination?) 

(3) Does it show ‘heads’ or ‘tails?’ 

(4) Is it bright or dull? 

(5) Is it in good condition, or scratched and marred? 

(6) What is engraved on it? (What does it say?) 

(7) How is it fastened to the cardboard? 

(8) Did you notice.a button? 

(9) What is its shape? 

(10) What is its color? 

(11) Is it the same color all over? 

(12) bi it made of cloth or of some other substance? 

(13) How many holes are there in it? 

(14) How is it fastened to the cardboard? 

(15) Did you notice a srnull picture {print) near the top of 

the cardboard? * 

(10) What shape is it? 

(17) What does it represent? (What is it about?) 

(18) Haw many persons are there in it? 

(19) What is the lady doing with her right hand? 


^'8 may Interfere with this progn'am, either by anticipating the answers 
to some questions, or by coiumiUing errors, c. g., describing an essentially 
different scene in the larger i)hotograph ; in such an event, E must devise 
other questions to follow up the cues thus given. Thus, if to Question 14, 
8 replies “By a thread,’* ask further questions, e. g., “Do the threads pass 
through 4 he holes or around the whole button?” “Draw them ** “What 
color are they.” etc : 


It is probably better to question 8 concerning ob.l^ts that he falls to 
mention m his narrative, save that, naturally, if the first question In each 

group. Did yon notice ?” is answered negatively, the remaining 

questions about that object are omitted. Many children fall spontane- 
^ ic(^Il one or more objects, but can nevertheless answer correctly 
questions about them, once the object Is suggested. 
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(20) What is the other person doing? 

(21) Where is he sitting? 

(22) What is he looking at? Describe it exactly. 

(23) Is the name of the picture printed on it? 

(24) yid yon notice another plcturcf {A photograph f) 

(25) What shape is if? 

(2G) What does it represent? ^ (What 4s it about?) 

(27) How many persons are there in it? 

(28) How are they dressed? 

(20) Where are they standing? 

(30) How many animals are there in the picture? 

(31) Is the cart on wheels or not? 

(32) Are there any words printed in the picture? What are 

they? 

(33) What did you see in the background (in the back of the 

picture?) 

(34) What did you see in the foreground (in the front of the 

picture?) 

(35) Is the picture taken in summer or winter? How do you 

know? 

(30) Did you notice a stamp? 

(37) Ts it Anrerican or foreign? 

(3vS) How much is it worth? (What denomination?) 

(39) What color is it? 

(40) What is on it? (What picture or printing is on it?) 

(41 ) On what part of the cardboard is it? 

(42) Is it a new One or.has it been used? (Describe the can 

cellation mark.) 

(43) Did you notice a label (stickerj paster?) 

(44) What color is it? 

(45) What shape is it? (Is it perfectly rectangular? Draw it.) 
(40) Is there any printing on it?* AVhat? 

(47) Ts there any border around the printing? 

(48) How is it fastened to the cardboard? 

(49) How is it placed on the cardboard — right-side up, slant- 

ing, or how? 

(50) What color is the cardboard? 
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Variations of Method,— (1 ) To shorten the experiment, omit 
the narrative and take onlj the deposition, but first ask to 
name the objects seen. Record the number. 

(2) .Matur(‘ aS \ s ma v be tested in small groups, though this is 
not ro(*ominoiuled. Both narrative and deposition must then be 
written bj the >S'8. For comparative purposes, the sarne pro- 
( odure must be iollowed for all aS'^s, since oral and written re- 
])orts cannot be assumed to be equivalent. 

(3) To induce a moderate degree of suggest lOn, E may recast 

the questions of the abov(’ interrogatory into an ex))ectative form 
and add others, c. f/., in place of No. 14: not the button 

fastened to the cardboard by a thread?’’ In place of No. 30: 
‘fisn’t there a little dog besides the borse?’’ In ]>bice of No. 42 ; 
^‘Isn’t the postage stamp cancelled?” Or, for additions: ‘^Isn’t 
there a seventh object on the cardboard?” ^^Draw it.” ^‘Are there 
not four wheels on the earl ?” ole. 

(4) To induce a strong degree of suggestion, E may recast 
the questions given into an implicative form, and add others as 
desired, c, //.. in ])laee of No. 9 : ‘‘Draw the button so as to shove 
the pla(‘(^ where it is broken.” In ]>la(‘e of 30 : “Are lioth liorses 
of the same color?” In })]ace of 42 : “Describe the cancellation- 
mark on th(‘ staniju” In addition to 40: “What else does the 
label have eai it besides ‘Glass. Uandle with care.’?” Or, in 
[dace of 21 : “Is the little boy's mother putting her arm around 
him as lie sits in her lap?” For additional questions, devise 
a Dinnber such as: “Is the lady’s necktie dark brown -or 
bine?” etc. 

Results. — (1) With regard to the number of objects spon- 
taneously recalled, the following results indicate the outcome 
found by Binet^ with 23 children 9 to 12 years of age and by an 
ex]Huamenter from the author’s lalioratory (12b). with 34 school 
children in the fourth grade of an Ithaca (N. Y.) public school : 


Number of objeois 5 4 AvTrngc. 

Froiu’li cliildren 4 10 8 1 4.78 

ithnea chiMren 14 10 G 4 5.00 


Counting 1 for (\‘i(*h right answer and 0.5 for each partly right 


n (letailtMl ]tro.senta1ion of tbo.so result.9, see his book (3, pp. 255- 
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answer, the Ithaca children scored in their depositions (possible 
score = 50) an average of 30.5, with a maximum of 43.5 and a 
minimum of G.5. 

(2) Bearing in mind that the actual objects differed some- 
what, the reader njay compare Binet's results and our own with 
regard to the older and fre(]uenej of omission in the narrative: 


Name of obioot stamp label biilton eoin small pirUiee lar^^e pietiiro 

French children 10 0 4 3 2 0 

Ithaca cliildreii 8 0 C 7 a \ 


(3) In tests of older children with written narratives, Binel 
found little difference in (he total number of objects mentioned, 
but marked dilTerences in the wealth of details and the precision 
of their formulation. 

(4) The objects have distinct individuality, i. c., though ^ 
may forget the color or the value of the stamp, yet if he recalls 
the object at all, it is as a stamp, not, for instance, as “som<‘ 
square, gTeenisli-colored thing.’’ In otlier words, S recalls a 
thing, not a number of meaningless attributes.'' 

(5) >V’s may re])ort very precisely and with assurance objects 
or features of objects wbicli are totally ineorrect, c. g.. they may 
draw the thread fastening the button, and lake oath as to its 
]>resence. Hence, testimony given with precision and detail and 
with the highest degree of assurance may be absolutely false. 

(G) aS’s may recall one feature of an object exactly, but fail 
entirely in their descrijdion of another feature of the same ob- 
ject, c. f/.y recall that the label is red, but err as to its shape. It 
follows that, iu testimony, a witness whose assertions are veri* 
lied immany details may, nevertheless, err in his statements with 
regard to some other detail that happens not to be susceptible 
of verification. 

(7) If S fails to mention an object iu his narrative, but re- 
calls it immediately in the interrogatory, his further character- 
ization of it may be quite as accurate as that of other S’s who 
had recalled it spontaneously. 

•‘In tbe author’s study of range of rlsual apprehension, however, there 
appeared numerous eases of the character thus denied by Binet for exam- 
ple, a nickel was recalled only a.s “something bright and round in the 
upper corner of the cardboard.” 



TEST 32 : FIDELITY OF KKPORT 


[ 393 ] 27 


(8) In comparing different types of questions, Binet found 
26 per cent, error for indifferent, 38 per cent, for moderately 
suggestive, and 61 per cent, error for strongly suggestive (jues' 
lions. 

B. UEPORT-TEST WITH A COLOUEl^ PICTURE 

Materials. — S et of four colored pictures: ^^Australians, 
Dis])uted Case,^’ ^‘Washington and Sally,’- and ^Tlie Orphan's 
Prayer.”-^ Watch, 

]Mlttiod. — G ive 8^ ins! ructions analogous to those in the pre- 
ceding form of report-test, hut without s])ecifying the time of 
exposure, J^xpose the picture for 20 sec. Secure an oral narra- 
tive and deposition as directed above. Suggestions for interrog- 
atorif^s for two of the pictures follow. 

[nterrnfiaiory for ‘‘A Dispiiied Case’^ 

(1) How wide is the ])ict;ure (horizontally) V 
^2) Jiow high is the ]>icture (vertically) ? 

(3) Is there any border : if so, what color? 

(-1) Row many persons are there in the picture? 

TaJvC the t>erson on your right: 

1^5) Is he young, middle-aged, or old? 

(6) What is his posture, —sitting, standing, or lying down? 

(7) What is he doing? * 

(8) What is his facial expression? 

(9) Is he bald or has he abundant hair? 

(10) What color is his hair? 

(11) Is he smoptli-faced or has he a moustache or a beard? 

(12) What color is his beard? 

^\II four i)U'tm*oy nn»y ho ])ro( ured throui^h C. IT. Stooltin" Co., (‘hicnc^o, 
111. The “Australians’’ is a lari^e litlioj^raph, oaie of a series calleU Leutc- 
niann’s n’ypes of Nations, cataloc^nod by E. StciLTr & Co., Now York City. 
It is reconimonded for use with larpre ^croups, numbering from 10 to 50 or 
more aS’s. ’Fhe “Hindoos” lithograph prescribed in Test 81 may be used 
with this for check tests, as it Is of the same dimensions and of similar 
character. 

The “Disputed Case” (No. 1235 of the Taber-Prang Art Co.’s colloetion) 
is recommended foV use save for very young children or for large groups. 
'Washington and Sally” and “The Orphan’s Prayer” (Nos. 000 and 1207. 
respectively, of the same ertllection) may he used for subsidiary and <^he<’U 
tests. 
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(13) Does his moustache conceal his mouDi ? 

(14) Does he wear eye-glasses or s}km (acles ? 

(15) Has he a hat on What kind? Whul col<n ? 

(IG) Where is his right liand? 

(17) Where iS liis left hand? 

(18) What ;‘olor is his coat? 

^19) ^Vhat color is his shirt? 

Has he a collar on? 

(21) What color is his necklie? 

(22) AVhat color is his vest? 

(23) What color are his trousers? 

(24) Does he wear slippers op shoes or ]joo(s ? 

Take the ])erson on i/onr left 

(25-14) lte];eat (piestions 5-24. 

(15) 5Vhat kind of light or lam j) is nN<Ml ? 

(4G) Wliere is it placed? 

(47) 5Yhere is the ink-well? 

( 48 ) Is there no t a ] len in it? 

(49) 5Vhat color is (he dog? 

(50) Is there a (able or bench? 

(51) How long is it (really) ? 

(52) What color is the table cloth or covering? 

(53) Is the fringe of the same or of a (liflerent (‘ohn*? 

(54) Name the objects on the table. 

(55) How many chairs are there in tin* room? 

(5G) ' Is the rocking chair on your left or on your right ? 

(57) Is there an umbrella? 

(58) Do you think it is jet-black or dai*k blue? 

(59) In what position is it? 

(GO) Name the objects in front of the table on the floor. 

(Gl) Is there a satchel or dress-suit case in (In* room? Whiih 
(G2) Is it open or shut ? 

(03) What do the ]Mclurcs on (In* wall ri*}uvscni V 

(04) How many windows are visible? 

(G5) Can you see any detail of outdoor scenery through them 


il is desired to -econonii/e time, omit qiicslious 25 to 44. 
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((](]) How iiKuiy lia<s are there in the room? 

((h) jh'seribe and locate them. 

(G8) Can you recall the time ind’catcHl by tlie clock on llie 
wall? 

((»*)) ^Vlial o]>ject is on your extreme right? 

(TO) Are there any Itooks in this part ot the room? 

(71) What (‘olor is the wall? 

(72) IVhere is the newspaper? 

(73) Ilow Iiaig did you sec the picture? 

Jnicrruyniorij for the ^^Australians/’ 

(1) . How many }>eisons are there in the picture? 

(2) How many aiiimais? 

(3) What kind of animals? 

(4) What is the ]tersou on i/oar left doing? 

(5) What is the object behind him? 

((>) W hat is (he pei'son in (he middle of the i)icture doing? 

(7) Has (his jH-rson a beard or not? 

, 8) Is (he man who is in charge of the dog holding him by a 
leash (guiding rope) or by taking hold directly of the" 
serulf of his neck? 

(tt ) What ai*c the persons in the background doing? 

(10) Do the })ersoiis in the foregi’ound wear anything beside 

the loin cloth? 

(11 ) What color is their skin? • 

(12) What color is the dog? 

(13) What is the most ])eeuiiar thing that you noted in the 

ap])earanca‘ of (iie men in the ])icture? 

(14) W l>at objeets lie in the immediate foreground? 

(15) Is there tmy water ]*epresented in the picture? 

(16) Is the while man standing on the left or on the right? 

(17) Is the sun rej)resentcd in the picture as shining from your 

right or from .your left? llow^ do yon know? 

( 1 ITow lojjg did you see the picture? 

VArjATiox’s (»p jMetitod. — T ost the effect of varying the time 
of exposure^ of extending the time-interval behveen exposure and 
report, of repeating the report (narrative or interrogatory), 
without farther exposure, two or more times at intervals of sev* 
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eral days or weeks, of confronting with the picture for care^ 
ful criticisms of the report he has submitted. Though it is not 
advised as the best method, the substitution of written for oral 
narratives and depositions will permit an instructive class ex- 
periment. 

Typical I'esults. — The following narrative by a college 
senior, a man of vari(jd experience, mature, much traveled, and 
well trained, though of mediocre native ability, shows clearly 
the tendency of an adult S to describe a situation, a meaningful 
whole, rather than merely to enumerate details, as do many chil- 
dren. Indeed, the detail here is distinctly subordinated to the 
interpretative rendering. The narrative tells w^hat the picture 
is about, rather than w^hat it is. 

“Tbe picture, about JOxlO inches, represents a scene that w’ould be 
typical of a rural justice of the peace and a man who has come to ask his 
advice on some- subject. The Justice sits before his desk, an old niaiiu- 
script before him, one hand on his head as if he had not yet given his 
decision. The oiiice is tilled with hooks and on one of them in the left of 
the picture rests Iiis top-hat. The visitor seems to be troubled very much ; 
his clothing denotes that he is of a ditTerent station in life. He has placed 
his carpet-hag on the floor and his hat near it, as a sign of great mental 
strain, whicli seems to increase as he awaits the deoisiou. On the wall to 
the right is a double luai) of the world, showing, perha])s, that the Justice 
is a man of wisdom and a sour('o of information to his neighbors. The 
room, furniture, tlie manner of dress would iiave denoted a time long be- 
fore ours. 'J’ho men seem to. be al>out G5 or 70 years of age.” 

liT his deposition, this student rendered an unusnally full list 
of answers: the reply — don’t know” — is given only twdee 
(Questions 34 and 72). The range of report is, therefore, large, 
but tJie fidelity is relatively small, since all the statements that 
follow are erroneous ones from his report (those italicized are 
also attested statements) : 

The i)icturo is 11x14 inches. The man on (he right is huhl, iccars spec- 
tavlcs\ Jias Jiis rifjht hand on a paper, wears a collar, n purple tie, black 
trousers, and slii)pers. The man on the left is thinking hard, has a 
tronidod expression, wears a sandy moustache; lie inis his right hand in 
his pocket, his left on his Imec; he wears a light-colored vest and brown 
trousers. The room is lighted by a candle which stand.s on the pile of 
books. Ther^ is a pen in the ink-well. ' The table is 14 feet long, has a 
light-colored cloth top with fringe, of a different color. There are three 
elinirs in the room, the rocker being at the left. The umbrella is dark blue 
in color, and lies on the floor. There is a coat on the floor in front of the 
table; there is a basket on the table. The satchel is shut. One xoindow is 


*’See Ref. 34 for further suggestions. 
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visible. Tliere is a ebair at the extreme right of the picture. The wall Is 
white. (The cuspidor aud the newspaper are not recalled.) 

General Results of Tests of Report. — (1) Accuracy/. The 
chief siogle result of the Aussage psychology is that an errorless 
report is not the rule, but the exception, ev^n when the report is 
made by a competent 8 under favorable copditions. Thus, in 240 
reports. Miss Borst found only 2 percent, c Torloss narratives 
and 0.5 per cent errorless depositions. These errorless reports 
«are commonly characterized by very small renge, i. c.^ they are 
reports of ^^s who are C‘xtremely cautious and state only what 
iJiey are certain of. For certain types of material, particularly 
estimates of time, space, uuniber, etc., not only are erroneous* 
rejmrts the rule, but (be most common single answer is more 
likely wiong than right (Dauber). 

Tlie average 8, when no suggestive questions are employed, 
exhibits a coefficient of ucciiracg of a])})roximalely 75 per cent. 

i2) lounge and aceiiraciJ. There is no general relation of 
j-ange to accuracy, though, for a given 8^ it is doubtless true lliat 
tliere is an inverse relation between these two coefficients.^- 
(3) Range and other constants. There is no general iiaral- 
jelism between range of rei>ort and other coefficients wliich de- 
pend tfpon degree of assurance. 


TABLE 50 

C<>inj)amiivi Accuraev of Sicorn and Unsworn Statements 
{Stir II and Burst) * 



STERN 

STERN 

STERN 

BORST 

Range j frrors 


Range 

Irrors 

Range 

Lrrors 

Range 

L'rrorrs 

Positive statements— 

(100) 

13.G 

(100) 

1 19 

|(100) 

23 

(100) 

11.0 

S^vorn statements 

76 

11 

68 

i 7 

70 

i 14 

60 

8.2 

UnsAvorn statements... 

24 

20 

32 

1 

1 30 

! — 

40 

15.5 

Certain statements 

1 



j 

1 

i 

97.5 

; 10.1 

Uncertain statements. 



1 

t 

1 

1 

i 

2.5 

i 44.0 


Xoic~-M\ ri-ni'(>s are in per cents. T)ie resnlls, save those of the third 
njid fourth coknnns, refer to narratives, not depositions. 


’‘The reason for tliis lack of general relation between range and accu- 
racy is presniiiahly that there are two kinds of good witnesses — the one 
possesses good capacity of observation, recall and report, and hence exhib- 
its a large range and a high degree of accuracy ; tlie other cautious, and 
therefore restricts his range, which may he poor at best. 
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(4) Acenravy and aitestaiion. Generally speaking, attesta- 
tion does not gnaiantee accuracy; on the contrary, though Ihe 
number of errors is nearly twice as great in unsworn as in sworn 
testimony (according to Btcrn, 1.82 times, according to Eorst, 
1.89 limes as great), there still remains as high as 10 per cent, 
error in sworn testimony. These relations are shown clearly in 
Table 50/ 

(5) Dependence on sex. In all of Stern’s work, both in narra- 
tives and depositions, with pictures, or events, or estimations of 
times and distances, whether under oath or not, the reports of 
men have been more accurate (by from 20 to 33 i>cr cent.), 
though less extended, than those of women, and a similar sex- 
difference has appeared in some tests of school children. This 
superior accuracy of boys ])ecomes more evident when the report 
is diliicult to make. ^Stern’s conclusions, however, have not been 
confirmed by Wreschner Breukink, or Miss Borst. Wreschner 
found that among adultsiJv'omen did better than men. Breuldnk 
found that men students? reported slightly more than women, 
but with less accuracy, especially when colors were concerned. 
Ilis men, however, proved more resistant to suggestive cjiiestioiis. 
Miss Borst, similarly, declares women to be superior to men, but 
an inspection of her results shows that the sujKudority of women 
consisted in the fact that they returned a larger number of cor> 
rect statements, while the men did not make less accurate state- 
ments in their more limited reports. A recent and as yet unpub- 
lished investigation conducted by Boring ((>) in the author's 
laboratory, in which groups of boys and girls and of men and 
Avomen reported upon the events displayed in a moving picture 
leads to the conclusion that relatively little sex-ditTereiice exists 
between boys and girls (with a tendency in favor of the boys), 
Avhereas a quite marked and certain sai)eriority of men over 
women exists among adult a8’s. 

More speeifieally, Borst found that in the narrative tlio range of jnen 
was 7G per oCiit, and in the deposition 83 per cent, of tlio range of women, 
wliile the acenraoy of men in both forms of report was api)roximatelv 00 
l)er cent, of the accuracy of women. 

There is a similar discrepancy between Stern and, Borst with regard to 
the tendency to attestation; the former found that men swore to 71 per 
cent, and women to 85 per cent, of their report, m hereas the latter found 
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that men swore to 01 per cent, and women lo but' 59 per cent, of their 
report. 

. Boring: found evidence that boys tend to exceed girls in range of report, 
l;eudoii('y to oath and unwarranted tendency to oath, while girls undoubt- 
edly exceed boys iu reliability of oath. With adults, men apparently ex- 
ceed women in range of report, and they undoubtedly exceed them in 
range of knowledge, assurance, warranted assuMnee, assm*ed accuracy 
and reliability of oath. Women possess a very decidedly greater unwar- 
ranted tendency to oath. The fact that sex-differences in report are more 
pronounced in adults than in children accords wiin what we know of 
sex-differences in general. 


(G) Dependence on age. Most experimenters conclude that 
the reports of cbildreu are in every way inferior to those of 
adults, that their range is smaller, their inaccuracy greater, and 
their warranted assurance and reliability of assurance much 
lower because their assurance is too great. Stern concludes that 
during the ages 7 to 18 the range, especially the range of knowl- 
edge, increases as much as 50 per cent., but the accuracy, save 
in the deposition, does not increase as rapidly (20 per cent.). 
This development of capacity to report is not continuous, but 
characterized by rapid modification at the age of puberty. 
Nearly all experimenters have commented upon the e^xcessive 
suggestibility of children before the age of puberty. Cohn and 
Dieffenbaclier detected improvement’ in fidelity up to 15 years in 
boys, but u]) to 20 iu girls. 


Stern has endeavored to analyze in part the development of the child’s 
capacity to reporl, and has distinguished four stages: (1) the very young 
child enumeiatos only isolated objects or persons (Binet s enumerator 
type) : (2) at about tbe eighth year, actions arc reported more carefully 
(o) during the years 9-10, attention is 'for tlie first time paid to spatial’ 
temporal and causal relations; (4) in a still later period there appears 
the capacity to make a rjualitaiivi analysis of the constituent features of 
the objects reported. Cohn and Dieffenbaclier think that there should 
perhaps be added a fifth period, from lU years on, when the report shows 
evidence of reflective and interpretative consideration. 

The question as to whether the testimony of children is so imperfect 
as to warrant absolute exclusion from court proceedings has given rise to 
much discussion. Thus, Baginsky, the German specialist in chil- 
dren s diseases, declares that children are the most dangerous of nil wit- 
nesses and demands that their testimony be excluded wherever possible 
Gross, the leading German authority on criminal law and criminal psy- 
c mlogy liowever, jisserts lhat .a healthy half-grown boy is the I,esl pot 
fiil.le witness for simple events, lhat children make different errors but 
no worse ones tlian do adults, w’hile, in respect to freedom from prejd'dioe, 
erroneous interpretation, emotion, intoxication- and the like a child is 
better fitted than an adult to give an accurate report. 

Lipmaim contends, quite on the contrary, that the unreliability of chll- 
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(Irenes testimony Is due in part to an uncritical filling out of gaps In 
memory, and in part to an unskillful distribution of tlie attention (tfiough 
the child’s attention is well enough concentrated on what he does report), 
Heindl says that children are perfectly good observers, perhaps even more 
objective tjiian adults, but that they cannot translate their observations 
into verbal reports skillfully. 

The work of Boring was specially directed toward this controversy. He 
found men superior to boys in all coelRcients, save assurance, assured 
accuracy and tendency to oath, in which there was no decided difference. 
Women exceed girls unquestionably in both range and spontaneity of 
report;, women display a greater tendency to oath and a greater war- 
ranted tendency to oath, but they also display a greater unwarranted 
tendency to oath and a lesser reliability of oath, i. e., they seem to be 
less cautious than girls. 

(7) Dependence on intelligence. There is no conclusive evi- 
dence upon the relation between good report and general intelli- 
gence. Winteler found no difference in range of knowledge and 
fidelity of report between the three most intelligent and the four 
least intelligent in his classes of 10-year-old boys. 

(8) Dependence on social status. That intelligence may, 
however, play a positive role is suggested by the conclusions of 
Breukink that physicians, professors and teachers give more 
extended and more accurate reports than nurses and laboring 
men, and that the cultured group is much less open to suggestion 
than the uncultured and much less liable to take oath to their 
answers to suggestive questions. 

(9) Defectives. The reports of defectives, paralytics, epilep- 
tics, the insane, etc.^ show, as one might expect, a very high de- 
gree of inaccuracy, eveu when the pathological condition is not 
seriously developed. Such persons are also highly suggestible 
(de Placzek). Dupree points out that the reports of such per- 
sons are peculiarly dangerous when their deficiency is latent or 
concealed. Gregor found that paralytics were not very bad re- 
porters when the conditions were all favorable, but that they 
fell off decidedly under less favorable conditions — long time- 
interval, suggestion, etc. 

(10) Dependence on timednterval. Lengthening the inter- 
val between experience and report tends, on the whole, to reduce 
range and accuracy, but there is nothing like the loss in eflBciency 
shown in typical curves of forgetting for nonsense syllables 
and similar material; indeed, for some the report may, be 



TEST 32 ; FIDELITY OF EBPOBT [401] 85 

iQiproved in some respects after several days have elapsed* Dal* 
lenbach'S figures (Table 51) may be taken as fairly typicaL 

TABLE 51 

Effect of Time-Interval on Report :,DaUehbach) 


INi^VAL 

NARRATIVE 

DEPOSITION 

Itemik Kecftlled 

Per Cert. Error 

Questions 

Answered 

Percent. 

Error 

0 

765 

10.5 

880 

14.1 

5 Days 

735 

14.3 

855 

18.2 

15 Days - 

750 

18.0 

854 

20.7 

45 Days 

569 

22.4 

801 

22.4 


From bis earlier tests. Stern computed a fairly coustant decrease of 
accuracy with time, amounting, on the average, to a loss of 0.33 per cent, 
per day over the period of three weeks which he studied ; similarly, Borst 
computed a decrease in accuracy of 0.27 per cent, per day during a period 
of six days. 

Though range and accuracy seem thus to suffer with the lapse of time, 
assurance, as shown by the number of certain and attested statements, 
is not, it seems, equally affected, but shows either a surprising constancy, 
or, if anything, a tendency to increase, i'rom this it may be concluded 
that a^urance and tendency to oath are due to /Sf’s ‘personal equation’ 
rather than to the freshness of his memory. It would follow, of course, 
that warranted assurance and warranted tendency to oath decline with 
the lapse of time. 

In explaining the improvement found in some reports after lapse of 
time, Schultz contends that perseveration Is one of the disturbing factors 
in reiiorts made shortly after the experience ; in s© far as perseveration Is 
a tendency that weakens with time, there would thus be less inaccuracy 
from this source of error in later reports. 

Jaffa asserts, more positively, that narration directly after an event by 
no means gives tlie best result ; rather the memory ot the event Is organ- 
ized and consolidated several wt^ks later and tlien affords a far more 
faithful picture of the event than an account after a brief interval. It 
seems doubtful, however, whether such a view can be accepted as a gen- 
eralization, however true it may be under some conditions. 

That the lapse of time occasions various and complex modifications is 
also Indicated by the work of Cohn and Dieffenbacher, who compared 
direct descriptions of one colored picture (Test 31) with narratives and 
depositions upon another colored picture with an 8'day interval between 
presentation and report. Here, while there was a positive correlation 
bet>veen range of description and range of narration, there appeared dis- 
tinct differences In the nature of the two accounts, e. g., acts and interpre- 
tations are more prominent in reports than in descriptions. 

(11) Dependence on form of report. All authorities agree 
that the use of the interrogatory, whether of the complete or in* 
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complete form, increases the range and decreases the accuracy 
of the report. Thus, in comparison with the narrative, the range 
of the interrogatory may be 50 per cent, gi’eater, while the inac- 
curacy (of the ineojnjdete interrogatory) may be as much as 550 
per cent, greater. In general terms we may say that about one- 
tenth of the narrative is inexact, but about one-quarter of the 
deposition. Typical statistics are given in Table 52. Cohn and 
Dieffenbacher believe that reliability should always be computed 
from the narrative and deposition combined, because only thus 
can differences in the two forms of report be eliminated. 


TABLE 52 

Dependence of Report on its Form {^tern and Borst) 


AUTHOR 

RANGE 

1 ACCURACY 

Narrative 

Deposition 

! Narrative 

i 

1 Deposition 

i 

1 

Stern * 

25.5 

52.1 

Per cent. 

94 

1 Per cent. 

' 67.1 

Borst - j 

40.5 

65.6 i 

! 

89 

83.0 


Foie . — In comparing these figures, it should be remembered that Stern 
used an incomplete, and Borst a complete in ter rogatory. 


According to Breqkink, the use of written instead of oral re- 
ports apparently tends to increase the number of indefinite an- 
swers, but to decrease the number of erroneous answ'^ers. 

(12) Dependence^ on the type of question. The work of 
Stern, Lipinann, Binet and others shows that the introduction 
of leading or suggestive questions decidedly decreases the accu- 
racy of rej»ort in children and may affect seriously the testimony 
of uncultured adults, or even of competent adults unless the con- 
ditions are favorable. Stern (33) estimates 50 per cent, error 
for 7-year-old children and 20 per cent, error for 18-year-old S’s 
in replies to suggestive questions. Most experimenters have 
found w^omen less resistant to suggestive questions than men. 
Cohn and Dieffenbacher find relatively slight differences in 
the suggestibility of boys and girls, though the boys tend, on the 
whole, to take a somewhat more critical attitude. They find that 
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the decrease in suggestibility with age is more marked in ^rls 
than in boys, and that greater suggestibility in dull as compared 
with bright pupils is evident in girls, but not in boys. These 
investigators call attention to the fact that a suggestive question 
that is introduced too abruptly (so that its very form attracts 
attention) is apt to arouse imnaediate resistance. 

(13) Dejyendence on contents or feature . Not all the fea* 
tures of the original experience are reported with the same fre- 
quency or with the same accuracy. In general, we may say that 
persons and their acts, objects, things and spatial relations are 
reported with considerable accuracy (85-90 per cent.), whereas 
secondary features, especially quantities and colors, are repotted 
with considerable inaccuracy (reports on color have an error of 
from 40 to 50 per cent.) In his subsidiary test with geometrical 
forms of different shapes, sizes and colors, Dallenbach found the 
errors most frequent with color, next with position, next with 
size, and least with shape, and this regardless of time-interval. 
Of the colors, errors were most frequent with green and least 
frequent with yellow tone. On the reliability of different 
classes of S'h with respect to different features, see further the 
tables of Cohn and Dieffeiibacher (11a, pp. 8Gf.). 

(14 ) Dependence on the ideational type of the reporter. The 
best reports are given by observers of a mixed ideational type, 
e. g.. acoustic-motor or visual-motor (Borst) : even in a picture- 
test, the purely visual-minded observer is* inferior, though less 
open to suggestion (Lobsien). 

A characteristic analysis of reports, for the purpose of classifying re- 
<porters into icleational tyi)es has been given in the description-of-an-object 
test (No 3!), In which Binet distinguishes four types of rerK)rter — the 
observer, the descriher, the emotionally-minded, and the erudite. Miss 
Borst was unable to use this classification, however, with her *S^’s. 

Another ciassification of reporters according to mental type was at- 
tempted by Miss Borst, ■who, after a preliminary tachistoscopic test, com- 
pared the reports of ‘fixating’ and ‘lluctiiatiiig’ Sf’s, and concluded that iS’s 
whose attention is of the ‘fixating^ type have uniformly the greater war- 
ranted assurance of report. There was no relationship found with extent 
o.f report 


(15) Qualitative analysis of errors. Stern finds four kinds 
of errors in the narrative: (a) errors of apprehension (observa- 
tion), like overlooking, misapprehending, underestimating, over- 
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estiraating, etc.; (h) real errors of memory, like forgetting, fill- 
ing in of gaps, gradual amplification, etc.; (c) errors of imagi- 
nation, ‘retouching’ the recollection, unintentional blending of 
imagined experiences with the one reported, or the harmless 
‘playing’ with the re[)ort (Fahulieren) often seen in children, 
and (d) errors of judgment (wdll), like lack of caution or self- 
criticism. 

Schultz (29) has also attempted a qualitative analysis of the 
material gathered by Aall in an event test. The following are 
the main points upon which stress is laid : 

(a) Whether an item is reported depends both upon the mental state 
at the moment and also upon the objective complex in which the item 
occurs. Attention is attracted by novelty and by the logical significance 
of the impression. 

. (b) But there is a certain ‘spread’ of attention such that details that 
Are trivial and accessory may also be included with those that is aiming 
to observe. 

(o) The novel attracts attention, but it is also difficult to observe cor- 
rectly. - Optimal conditions are given when a familiar thing (easy to 
understand) is in an unfamiliar setting (motive of novelty). 

(d) An event which suddenly breaks into consciousness and disturbs 
the set of the moment is a source of difficulty until a new adaptation for 
it is secured. 

(e) “Perseveration plays an important role in the mistakes of wit- 
nesses.” Its falsifying effect decreases with time, and thus reports that 
are separated by a time-interval from the event may be better than imme- 
diately given reports. 

if) There takes place a process of logical elaboration, the effect of 
which is to emphasize the kernel of the episode and to minimize unessen- 
tial details (principle of conscious economy). 

(g) This tendency also operates to distort reports so as to mate them 
conform to what the witness regards as the natural course of events. Por- 
tions of the episode unperceived . or not understood are filled out or re- 
arranged in accordance with this principle. Characterizations of persons 
especially show this tendency. 

(70 >Iany /Sf’s show a distinct tendency to embellish or round out their 
reports Into good literary form, and may thus unwittingly distort their 
statements. 

(t) If the experience moves 8 emotionally, his reports are strongly col- 
ored and may suffer decided modification, particularly reports upon verbal 
items (quotations). 

(/) Experiments so arranged ns to cause 8 to believe that his report 
is serious and responsible (not a mere classroom test) produce a different 
conscious attitude and reveal the presence of new factors, both Inciting 
and Inhibitory; in general, the effect Is to augment the value of the 
testimony, 

(fc) That a witness should be motivated by a desire to awaken a cer- 
tain Judgment upon a case need not be an undesirable condition. 
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(16) The effect of repeating a report. When is called 
upon to make his report several times, the effect of this repeti- 
tion is complex, for (1) it tends in part to establish in mind the 
items reported, whether they be true or false, and (2) it tends 
also to induce some departure in the later reports, because these 
are based more upon the memory of the verbal statements of the 
earlier reports than upon the original experience itself, i. e., the 
later reports undergo distortion on account of the flexibility of 
verbal expression. 

(17) The effect of practise: edneahilitif. On the basis of 
Miss Borst's work (Table 53), it would appear that siiuide prac* 


TABLE 53 


Effect of Practise upon Coefficients of Report (Narrative) (Borst) 


NUMBER OF REPORT (TEST) 

I 

II 

III 

rv 


Range 

39.0 

39.0 

42.3 

f 

40.3 

42.0 

Accuracy 

80.6 

87.7 

92.9 

88.2 

90.0 

Assurance 

96.6 

i 9B.4 

97.8 

97.9 

98.6 

Warranted assurance 

, 84.0 

i 87.0 

91.0 

88.0 

89.0 

Reliability of assurance 

87.5 

89.4 

92.6 

89.8 

90.3 

Assured accuraev 

97.0 

98.0 

98.4 

98.6 

99.2 

Tendency to oath 

43.0 

59.8 

62.8 

61.9 

72.1 

Warranted tendency to^oath,. 

40.2 

53.2 

58.5 

57.5 

66.5 

Unwarranted tendency to bath. 

2.8 

6.6 

4.3 

4.4 

5.6 

Rcliability of oath 

93.0 

88.8 

.92.5 

' 

93.0 

91.7 


yofr.--Tlu> elTei’|.of prao 'isc in these tests is somewhat obscured by the 
fact that the first and third tests were made after a 3-d:iy, the others after 
a i>daj interval. 


witlioiit special coaching or conscious effort to improve, 
facilitates the report. Tu her work it will be noted that the 
tendency to oath and warranted tendency to oath are both par- 
ticularly improved, while there is appreciable improvement in 
the other coefficients, save assurance and assured accuracy. On 
the other hand, some doubt is cast upon generalizations from 
TvTiss Borst’s work by the reports made by Baade and Lipmann 
for the Commission of the Institute for Applied Psychology ap- 
pointed especially to investigate this problem of the educability 
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of report. Baade shows that with regard to reports made upon 
verbal statements .(quotations) the S^s (196 girls, aged 12-13 
years) showed no demonstrable improvement, either as a result 
of the threefold repetition of each experiment (physical labo- 
ratory demonstrations) or as a result of the succession of three 
different experiments. There was an influence of earlier upon 
later experiments, but this influence was sometimes favorable 
and sometimes unfavorable. Lipmann, who scored the estimates 
of duration and size, found, on the whole, some improvement in 
these estimates due to the succession of experiments, but only a 
very slight improvement due to the repetition of given experi 
ments. 

Other experimenters have reported results more nearly in 
accord with Miss Borst’s conclusions, Breukink, for instance, 
found that if are allowed to vsee the picture after reporting, 
the practise increases fidelity of report, especially in the deposi- 
tidh and in resistance to suggestive questions. Again, the very 
interesting Methode der Entscheidungs- tind BcstUnungsfi'agen 
(questions in form of : ^^Do you know thus and so?^’ and ^AYhat 
is thus and so?^’ respectively) has led Franken to declare that 
such training as this method induces, causes an improved cau- 
tiousness in asserting positive knowledge. 

Other experiments by Marie Durr-Borst (1000) indicate that 
improvement in the capacity of children may be best secured by 
appeal to zeal, interest, enthusiasm and desire for improvement, 
\vhereas more formal training of an intellectual type — sugges- 
tions for systematic observation, specific training in sense-per 
ception, etc. — is much less effective. 
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CHAPTER IX 


Tests: of Association^ Leaunino, and Memory 


A generation ngo, the members of the ‘English SchooT of psy- 
chologists exalted 'association’ as a fimdair' ntal principle or 
law of mind comparable in its scope and importance with the 
law of gravitation in the material world. Whether this extreme 
position be held or not, it must be admitted that the more com- 
plex phases of mental activity are more readily understood if 
certain basic conditions of mental elaboration are posited, par- 
ticularly the conditions: attention, retention, and association. 
Disregarding the first of these, which we have already discussed, 
we find in retention the sine qua non of the development of 
human mental activity, and we find constantly at work in the 
conscious life of the organism a tendency for the establishment 
of connections between its concurrent and its successive psycho- 
pnysical activities. In so far as the conscious organism acquires 
new capacities for response, there must be retention and organ- 
ization. learning, retaining, recalling, associating, these are 
terms obviously descriptive of a series of related activities, and 
on this account, tests which deal with them are here assembled. 

Association and memory, taken together, have undoubtedly 
been the occasion of more numerous and metre elaborate experi- 
mental investigations than any other phase of mental life. 
Ixiarning, in the narrower sense, has, perhaps, received some- 
what, less attention, though of late the imy)ortance of its appli- 
cation to pedagogical problems has stimulated work upon it. 

The experimental study of associative activity can be, and has 
been, undertaken for quite varied purposes c. r;., to examine the 
time relations of mental j.hcnomena, to study individual differ- 
ences in thought-processes, as conditioned by age, sex, training, 
physical condition, and the like, to qnalyze the diurnal curve of 
psychophysical efficiency (as in Kraepelin-s use of computa^ 
tion), to diagnose mental content, and even to reveal obscure 
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mental tendencies and motives or intentionally withheld infor- 
mation (diagnostic association tests). Space forbids the ex- 
ploitation of a]] the tests tliat have been developed in these 
fields, but a study of tlic more cojnmoii tests of learning, associa 
tion and meinorv that have been selected for treatment here as 
being most applicable to the experimental study of school chil-, 
dren will sirve to indicate the lines along which variant meth- 
ods may be developed and employed. 

The earlier tests in this chapter investigate the nature and 
efiieiency of tliose associatite connections that the subject has 
already (‘staldished at the {ime of the test, either when the asso 
eiative processes are allowed free rein (uiieonlrolled associa- 
tion) or when they are placed under certain restrictions (con- 
trolled association). The tesis of learning that follow investi- 
gate the subject's capacity to establish new associative connec- 
tions, under relatively novel conditions. The memory tests, in 
a somewhat diffcient svtiy, investigate his retentive (*apaeity or 
his ability to rej)roduce a series of syujbols or a series of related 
ideas. The classitication of tests of association, learning and 
memory is, of coiuse, somc-whai rough; it is difficult to draw 
sharp distiuclioiis ])etweeii eacli type or to delimit precisely the 
mental processes that are ‘oumght into operation, as is illus- 
trated, for exam]>]e, in llu obvious overh{]>piiig of tests of 
memory, of uieiaory-spau, of report, of range of altenliou and 
range of apprehension. 


TEST 33 

Uncontrolled association — continuous method. — The essence of 
this test is the requirement to write or imonoiinee an extended 
series of words not in the form of sentences. Our interest lies, 
first, in the difference of facility exhibited by different >Sf’s in the 
production of sudi a series of terms; secondly, in the nature of 
the terms given by S'h of different sex, age, or social condition ; 
and thirdly, in the nature of the mental processes underlying the 
word-naming process 

Oattell and Bryant (4) make brief mention of the test; Jas 
troAv (6, 7), and later Miss Ndvers (10), Miss Calkins (3), Miss 
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Ta liner (ii) and Miss Manchester (8), employed it for the study 
of llie eoiniiuinity of ideas of men and women, Flournoy (5) for 
(he study of the etfect of ouvironnient, present and iiniuediatcdy 
]>as(, u])Oii the course of association, and Itiiiet (1) for the sludy 
of individual diderences in intellectual proc'esscs. In a modiiled 
form (test of 00 words in 3 min.) it appears in the Binet-Simoii 
Scale (Oh. XIll). 

Materials. — Stop-watch. Blank forms containing’ numl)er(‘d 
sjiaces for 100 words. [The seconds-clock.] 

Method. — Give iS these instructions: ^-Wlieii I say ^now,’ I 
want you to start in witli some word, any one you like, and kw^]> 
on saying words as fast as you can until you have given a hun- 
dred dillereiit words. You may give any words you like, but they 
miisi not be in sentences. I will tell you wlien to stop.’’ E starts 
the stop-watch at the command hiow’ and writes on the prepared 
form the words spoken by S. With mature 8'’s, it may be pos- 
sible to get nothing more than scant abbreviations foi the more 
raiiid portions of the series, but these may be filled out sulise- 
quently. The points at which 8 makes distinct pauses may be 
noted on the form. At the 100th word, stop the watch and record 
tlie time. If time permits, and S can do so, it is advisable at 
once to go over his series, not only to fill out the list of terms, 
but also to make marginal notes of all the intermediate links and 
subsidiary associative processes that he can recall. 

\'auiations oe Method. — (1) For group tests, E should pro- 
vide caches' with a blank. He*may allow 3 min. for writing, and 
rate speed in terms of number of words written (method fol- 
lowed by Pyle, 10), or eacii ^ tuay record his own time for 
writing 100 words by the aid of the seconds-clock for group tests. 
The latter procedure is recommended rather than the former. 
^Vhen 8 does the writing, the method resembles that of the users 
of it discussed below, but the standard meihod of oral naming 
is best. 

(2) Instruct 8 to keep his eyes closed during the test. This 
variant is to be preferred for individual testing, at least with 
adults ; Us effect is commonly to reduce the speed of naming and 
to lessen the number of terms suggested by objects visible in the 
room where the test is administered. 
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(3) Vary the test by demanding short lists, say of 20 words 
each, referring to the several categories indicated in the table 
which follows, e. g., ‘‘Name words pertaining to clothing.’^ 
‘‘Name abstract terms.’’ “Name adjectives,” etc. Note the time 
needed for each such list. 

(4) E may omit the instruction to write or to speak as rap- 
idly as possible, and allow S to work at his leisure. This method, 
which was followed by Miss Nevcrs, is perhaps more satisfactory 
for the subsequent qualitative rej>ort upon the series, but de- 
prives the test of whatever quantitative merits it possesses, be- 
sides tending to yield results of a distinctly different nature that 
are not comparable with those otherw ise obtained. 

(5) When w^orking with younger ^Sf’s, E may with advantage 
limit the length of the series. Thus, Flournoy demanded but 10 
wwds, w hile Binet recorded the time for three series of 20 words 
each, and occupied the intervals in reviewing with S the terms 
of the preceding series. This method is less fatiguing, and en- 
ables immature to give a more satisfactory account of their 
associative connections, but it does not test S^s capacity as 
rigorously as the longer list. 

(6) E may secure a very limited measure of uniformity in 
the earlier portion of the series by starting all ^’s from the same 
word. For this, the words qwich and play are recommended. 
Here it is of interef^t to observe the lines of divergence in asso- 
ciation taken by different 

(7) Another variation is that of Flournoy, who, in addition 
to the word test, gave 45 Sf’s ibstructlons to make 10 drawings 
of any sort. 

Treatment of'Data. — In the standard form of test, ;Sf’s speed 
is indicated directly by his time for naming 100 words. In the 
group test, it is customary, similarly, to rate /S^’s speed in terms 
of words wu’itten in 3 min. It is not possible, however, to regard 
the times obtained from these two forms of the test as inter- 
changeable, since the second form includes writing and this, as 
is demonstrated below, tends, even in the case of mature to 
slow the rate of performance. In so far, too, as S’s differ in their 
speed of writing, this fact enters as an unavoidable disturbing 
factor in the group test. 
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For qualitative comparison of the lists, E may, by inspection, 
supplemented by &'’s explanation, catalog the words, either in 
the 7 categories used by Binet, or in the 25 categories used by 
Jastrow, J\liss Nevers and Miss Manchester. Both classifications 
are embodied in the results below. 

Results. — (1) Some idea of the relation between perform- 
ance in the group test (words written in 3 uiin.) and age and 
sex in normal 8's may be secured from the averages published 
by Pyle for a limited number of cases and under less precise in- 
structions than those above recommended. These results are set 
forth in Table 51, where it will be observed that on the whole 
the number of words increases with age year by year, and that 
girls at nearly every age somewhat excel boys in their scores. 


TABLE 54 

Worda Writicn in Three Minutes by Normal Children (Pyle) 


SEX 

AGE 

sis 

10 

1 11 j 

12 

13 

14 

15 

la 

17 

18 

ADULT 

•Male— ! 

1 1 

Cases 

33 60 

66 

f 

[66 

77 

180 ’ 

57 ' 

38 

36 

16 

21 

64 


Male — 

Fern 

Fcm 

Fern 


Aver 

Av, Dev. 


Cases 137 |82 [88 |65 190 'eO |61 

Aver 123,7 31.0,32.2 36.8,36.6 38.3 39.1 

Av.Dev 1 8.2! 8,9 10.8jl2.1 15.4: 16.8jl2.9 


23.0 26.9,29.7,33.334.2 33.9 33.340.0 33.3:42.8148.9 
7.5i 7.6 9.0:114jl0.914.6 13,2:14.8 14.6 12.3ll6.G 


!46 i46 |38 |29 
140.2 40.9 41.647.1 


13.8114.114.013.9 


42.2 
13.8 

86 

38.3 
13.1 


(2) In tests of college students the average time for writing 
100 words ranges between 5 and 6 min. Jastrow reports an 
average of 130 sec. for oral and 308 sec. for written lists of this 
length. Since writing an equal number of words from dictation 
took 212 sec., he concludes that about 1.14 sec. was used, on the 
average, in thinking the association between one word and the 
next. 

(3) Table 55, derived from Wallin’s studies of mentally tie- 
fective epilepties (12), shows that the test of uncontrolled asso- 
ciation (here the number of words spoken in 3 min. under cer- 
tain special instructions necessitated by the nature of the S’s) 
is of some value for mental classification, since the average re- 
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suits show a steady increase T^ith increase in mental age 
(Binet-Simon diagnosis) when due allowance is made for the 
small number of eases tested in certain age*^. 


TABLE 55 

Words littered in Three 3Iinutes (Wel/in) 


Binet-Simon Age 


VII 1 

VIII 

IX 1 X 

1 

XI j 

XII 

XIII 

Average Words Spoken-: 

16.0 

25.5 

I 

21.5 

33.4 1 4.3.6 

51.3 

59.9 

65.0 


(4) Inspection of the lists printed both by Jastrow and by 
Binet shows that follow what might be termed a sc tics of 
thevies: a number of terms are written, all of which cluster 
about a common central idea ; through one of these terms access 
is given to a new central idea, which in turn becomes a theme 
for the next series of terms. Thus, in the series hand, face, lip, 
chest, knees, calf, cow, horse, pig, etc., the transition from the 
parts-of-tlie-body theme to the animal theme is effected by the 
common term calf, 

(5) 111 some >S’s, the controlling theme is an auditoiij sc^ 
quence, which occasions long series of rimed or alliterative 
termsj c. g., run, pirn, fun, etc., or ken, hand, head, harp, etc. 

(G) In this test, the 7nost contmon words, i, those most 
easily got at, or those that lie, as it were, on the surface, are 
given first. After these are delivered, the task grows more diffi- 
cult; deeper and more rejiiote-lying terms must be actively 
sought for. Closely related to this is the fact that, at least in 
the lists of younger N’s, practically' all the terms are nouns.^ 
This is particularly the euvse in the short series conducted by 
lUnet, so that, as he remarks, the test, as he conducted it, is 
virtually equivalent to a request to w'lite 20 common nouns. 

(7) In view of the vast number of words available, it is at 
first sur[U‘isiiig 1o note tbc degree of conunnnlty present in lists 

ol’h'ii the instriu-tions to niean that only nouns are 

wanted. It E stuns t<> explain that other xjarts of speeeli are periuissible, 
the result is soiueliuies more confusing yet, as they may then seek to name 
some of every part of speech. 
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<if 100 levins givcu hj a limited number of persons. Thus, Jas- 
Irow found that in 50 lists (5000 words), only 2024 words were 
different, only 126G words occurred but once, while the 100 most 
fretiuent words luadc up three-ienths of the whole number. 

These most frequent Avords arc, us has just been said, names 
of coinmoii objects : in JastroAv’s 50 lists, tic folloAving were the 
most frequently used Avords; bool- (40), horse (37), f/irl (35), 
nian (34), ho/y (33), iuhlo (30); Ihen'folhnv chair, tree, cow, 
pajior. dress, etc., in somcAvlmt lessor fi'cqueney 

(s) For tlu' classificalion of the Avords giA'cu by 20 12 year 
old ])U3iil.s, Itiuet found seven categories adequate, viz.: («) 
names of objects in the room Avhere the test was held, (h) ])arts 
of she pei'son or clothes, (c) objects or persons in the school, (d) 
objei'ts recalled from the hoim*, (c) objects seen in the streets 
(horse, tree), (/) objects seen in fields or on country excursions, 
i<j) unclassified nouns. Here th(>re is no place for abstract 
erms, many of Avhicli Avere found in series given by American 
impils in JastrOAv’s tests. .Tastrow’s oavu classification is indi- 
cated in (table 48, aa’Iictc it Avill be seen that his 25 categories 
arc much more elaborate and extended than those cmploAcd bv 
llinet. 

(9) Dependence on sex. The question as to sex difference 
in spontaneous trains of ideas such as are evqjied in this test has 
been ansAvered difl'ereutly by the tests conducted at ditfercut 
institutions. The comparison of Wisconsin men and Wisconsin 
wonien was made by Jastrow, tlie 1894 test ot Wellesley women 
by Miss Nevers and Avith no instruction as to speed, the 189G 
test of \rellesley women by Miss Calkins but with the same in- 
structions as those of JastroAv, the test ot 75 men and 75 women 
at the University of California in 1905 by Miss Manchesier afier 
dastroAv’s method. The categories of jiarticular interest are 
t hose print ed in i talics. J astroAv’s results in this and other tests 
led him to believe that “women repeat one another’s words much 
more than the men.” He found that “the class to which women 
contribute most largely is that of articles of dress, one word in 
every eleven belonging to this class. The inference from this 
that dress is the predominant category of the feminine (or of the 
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privy feminine) mind is valid with proper reservations.” Since 
the women exceed the men in the enumeration also of foods, 
amusements, arts, and educational matters, but fall below them 
in naming implements and utensils, professions, and especially 
in abstract ter ns, Jastrow concludes, ^^that the feminine trails 
revealed in this study are an attention to the immediate sur- 
roundings, to the finished product, to the ornamental, the indi- 
vidnal, and the concrete, while the masculine preference is for 
the more remote, the constructive, the useful, the general, and 
the abstract” (6 ; pp. 504-5) . Most of these conclusions are flatly 
opposed by the Wellesley results of 1894, but the employment of 
Jastrows’ methods in the 189G test produced less marked diver- 
gencies. It is particularly to be noted that writing at a faster 
rate (1896 test) caused a marked decrease in the number of ab- 
stract terms, and brought the terms relating to ^interior furnish- 
ings’ up even beyond those of the Wisconsin women ; on the other 
hand, the frequency of terms for ‘wearing appareP was not 
affected by this change in method. 

The three sets of 25 lists each (25 men and 25 women) pro- 
cured by !Miss Manchester at California show complete agree- 
ment with Jastrow’s results in the following aspects r men lead 
in naming (1) verbs, (2) implements and utensils, (3) occupa- 
tions; women lead in naming (1) wearing apparel, (2) build- 
ings and building matevials,-^ (3) interior furnishings, (4) edu- 
cational terms, (5) arts, and (fl) amusements. Miss Manchester 
generalizes these ditferences as follows: (1) ‘^The dynamic 
aspect of objects is more attractive to men, while the static or 
completed aspect appeals more to women.” (2) ‘‘Time as a 
factor enters more largely into the surface ideas of men ; space 
is more often a prominent feature of the surface ideas of 
women.” (3) ‘‘Men are interested in far-reaching relations ex- 
isting between things; women give more attention to the minute 
analysis of things themselves.” (4) “The range of the surface 
ideas of men, as a group, is slightly greater than that of women.” 

=In explanation of tbis seemingly unusual superiority of the women It 
should be said that the things named are not distinctive building mate- 
rials or operations, like mortar, cement, mortising, etc,, but such common 
terms as floor, door, gate, church, etc. 



TBST 33 I UNCONTHOLLBD ASSOCIATION [417] 51 


TABLE 68 

Distribution of Terms in * Uncontrolled^ Association (Jastrov^t Severs, 
Calkins, Manchester) 

{Each column reprt fients 25 lists of 100 words each. Those front Calf* 
for Ilia art based upon 75 lists reduced to the same basis.) 


CATEGORIES 

WISCONSIN 

MBN 

WISCONSIN 

WOMEN 

CALIFORNIA 

MEN 

CALIFORNIA 

WOMEN 

WELLESLEY 
WOMEN, 1896 

tz 

Kao 

K- 
2| 
H O 

1. Animal kingdom.™ 

254 

178 

214 

187 

146 

223 

2. Wearing apparel and fabrics- 

129 

224 

82 

118 

97 

96 

3. Proper names 

194 

153 

84 

92 

81 

141 

4. Verbs 

197 

134 

302 

258 

279 

114 

5. Implements and utensils 

169 

* 121 

115 

82 

139 

132 

6. Interior furnishings 

89 

190 

90 

119 

212 

84 

7. Adjectives 

177 

102 

208 

266 

300 

234 

8. Poods 

58 

179 

8! 

78 

88 

56 

9. Vegetable kingdom 

121 

110 

83 

90 

101 

91 

10. Abstract terms 

131 

97 

113 

101 

101 

280 

11. Buildings and building ma- 
terials 

105 

117 

m 

140 

86 

106 

12. Parts of body 

101 

105 

91 

62 

66 

34 

13. Miscellaneous 

91 

97 

197 

180 

123 

162 

14. Geographical and landscape 
features 

97 

80 

102 

114 

70 

142 

15. Mineral kingdom 

74 

96 

96 

58 

30 

54 

16. Meteorological and astro- 
nomical 

85 

76 

86 

87 

109 

26 

17. Stationery 

60 

86 

58 

M 

69 

26 

18. Occupations and callings 

71 

47 

60 

35 

24 

33 

19. Conveyances — 

62 

52 

44 

50 

19 

79 

20. Educational 

34 

76 

59 

74 

102 

167 

21. Other parts of speech 

96 

5 

108 

103 

164 

41 

22. Arts 

33 

61 

59 

79 

17 

44 

23. Amusements 

30 

53 

25 

45 

17 

102 

24. Mercantile terms 

30 

29 

13 

14 

18 

15 

25, Kinship 

17 

32 

9 

12 

42 

18 


Burt and Moore repeated Jastrow’s test both with children 
and adults of both sexes, with results that roughly confirm Jas- 
trow^s. ^The females are more personal and subjective in their 
interests; the males are more impersonal and objective. . , . 
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Women alter Uicir themes and topics far more frequently than 
men; men, on the other hand, show a greater variety of associa- 
tive connections between one idea and another within the same 
theme. The course of ideas is also more frequently disturbed 
in women by the various signs of ‘complexes^ (systems of asso- 
ciated ideas characterized by strong emotional colorings)/’ 

These discrepancies raise the issue, as Miss Tanner has 
pointed out, whether this test can be expected to reveal funda- 
mental native ditlerences in mental constitution of the two sexes, 
or whether it reveals merely acquired traits, social traditions, 
individual habits, educational and other environmental influ- 
ences. The lists written by college students might be expected, 
for example, to be considerably affected by their recent occupa- 
tions, courses of study i)ursued at the time, etc. 

The more direct comparison of the S])eed of the two sexes in 
naming terms of different kinds which we have suggested (Vari- 
ation of Method, 3) does not appear to have been attempted by 
any of tliese investigators. 

(10) This influence of eyivironmcnt upon the lists of associa- 
tions is indicated particularly in Flournoy’s brief tests (10 
words and 10 drawings), the results of which are summarized in 
Table 57. 

TABLE 57 

Influences that Affect * Uncontrolled* Series of Words or Drawings 

{Flournoy) 


Traced to present surroundings. 
Traced to the immediate pasL. 

Due to the milieu 


Traced to recent personal experiences 
^lYaeed to personal habits 

Expressing individuality 

Unexplained 


DRAWINGS 1 

WORDS 

Per ccut. 

Per cent 

13.8 

29.0 

1.9 

8,2 

15.7 

37.2 

2.4 

j 3.9 

39.2 

9.2 

41.6 

13.1 

42.7 

1 49.7 
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TEST 33A 

Uncontrolled association — discrete method (Kent-Rosanoff 
test).-— This test resembles the i>rcee<ling one in that it deals 
M'ith association of the free, unrestricted or uncontrolled type, 
but it differs from it in that H is called uj)oTi to respond with a 
single term only to each of a se. jes of words presented by E. 
This form of response has been, of course, the object of an ex- 
traordinai’y amount of investigation, particularly with refer- 
ence to Us time-relations. But in the special arrangement of 
the test developed by Kent and Rosanoff no attempt is made to 
measure the time-relations, and the search for devices for the 
logical classification of the responses (a decidedly prominent 
feature of many laboratory and clinical studies in association) 
is limited to a simple empirical sorting of them into ‘common,’ 
‘doubtful,’ and ‘individual’ respon.ses, on the basis of prepared 
frequency tables. 

Tabulated lists of the frequency with which ^Rfferent re- 
sponses are made to the stimuli presented in association tests 
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w6re constructed by Cattell and Bryant (4) as early as 1889, and 
since then have been develoi)ed to some extent by Gertrud Sab 
ing. (20) in 1908, and by Eeinhold (16) in 1910, while Bovet 
(1) has outlined several methods by which such tables might 
be handled in figuring a 'coefficient of banality.’ Nevertheless, 
the frequency tables * iiiiblished by Grace Kent and A. J. 
Rosanoff (10) in 1910, taken in conjunction with the supple- 
mentary reports upon their applicability made by Rosanoff 
with the assistance of Eastman (5) in 1912 and of Isabel 
Rosanoff (18) in 1913 and the recent study by Miss Otis (15), 
constitute so imi)ortant and well-standardized a development 
of the idea of measuring commonplaceness, or normality of re- 
sponse by means of empirical tables of distribution, as to war- 
rant the introduction of their test as a special and specific 
method of testing association. 

Whether the Kent-Rosanofl; test merits the rather extrav^a- 

\ 

gant encomiums that have been awarded it by some writers' 
appears to me extremely doubtful; it has certainly discarded 
whatever advantages might be secured by resort to introspec- 
tion and to the making of time measurements; it sets up an 
arbitrary standard of normality; valid at best only in the gross 
and when the test is conducted by certain fixed and probably 
far from ideal conditions for exploring individuality in mental 
connections. 

Materials. — Prepared forms comprising a printed list of 
100 stimulus words^ with spaces for recording responses, their 
times and their indexes. The Kent-Rosanoff frequency tables. 
[Stop-watch.] 


^Woodworth and Wells (25), for example, talk of the free association 
test as havin^; achieved, and being likely to retain, a i>lace “in the fore- 
most rank among the methods of individual psychology,” and assert that 
the form of it developed by Kent and KosanofT gives ‘‘i)crhaps the best 
objective correlate of temi)crament at present to hand,” and that it has 
“established a definite standard of normality” — statements that are hard 
to understand in the light of the results established to date. 

'Slxty-.slx of those terms are taken from the series published by Sommer 
!n his Diagnnsllfc dcr GcifdcsJcrnuJcliciten ; the remainder have been se- 
lected on tlii basis of preliminary experimentation in sneh a manner as 
to cover a variety of situations without being especially liable to call up 
personal experiences. 
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Method. — Seat 8 in a room free from distracting influences 
and with his back to E, Instruct him as follows : am going 

to read to you, one at a time, a series of 100 w^ords. Just be- 
fore each word I shall call out ^ready.’ As soon as you hear 
the word that follows the h'eady^ signal, you are to respond by 
saying the first word that comes to your r ind other thaii the 
word that I have just spoken. Your respon^se must be a single 
word, and you must say it just as quickly as you can.'' 

If 8y despite these instructions, repeats the stimulus word, 
he is cautioned not to do so, and the same stimulus is given 
again after several other stimuli have been used. If he con- 
tinues to repeat the stimulus word during some 25 trials, E 
should forego further attempts to prevent this form of re- 
sponse. If 8 responds by a sentence or phrase, a compound 
word or a grammatical variation of the stimulus-Avord, he is 
similarly Avarned of this infringement of the instructions, 
and the stimulus w^ords are similarly repeated later in the test- 
ing. In any event, the original response as well as the subse- 
quent one had best be noted in the record, though the second 
ones should be used in computing the results.^ 

If any response seems incoherent, devoid of any apparent 
connection with the stimulus, ask 8 why he responded as he 
did, and make a note of his explanation. 

As the test is somewhat wearisome with children, it is ad- 
visable to introduce a rest-pause of a minute or so after the 
50th word, or even after the 25th, 50th and 75th words. 

Variations of Method.— (1) Use the stop-w^atch to measui*e 
the time elapsing between the stimulus and the response. Start 
the watch just as the stimulus is uttered ; stop it w^hen 8 utters 
his response; record the time in tenths of a second. This varia- 
tion of method is strongly advised, despite the reasons advanced 
by Kent and Rosanoff for neglecting the measurement of the 
association time. The experience of other users of the Kent- 
Rosanoff test shows that the times are frequently valuable ad- 
juncts in diagnosis. E must remember, of course, that the time 


tn ^ A ^ T ^ children, say 4 or 5 years old. It will be Impossible 
i precisely. Thus the Rosanoffs (18) were 

ohliged In such cases to permit responses of a sentence form and to take 
the main word In the sentence as the desired single word 
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does not always measure tbe speed of the association that is 
recorded, since between stimulus and response more than one 
UHtritai pj'ocess may iidervene which is not reported by /Sf and 
which may be quite iinrevealed in (he word ho lifters. 

(2) Make tlm lesl without instructions for speed, but with 
(xplicit iustruetioiiS to adopt a quiet, leisurely attitude in 
which the asso{iation is allowed to develop ia wdiatevcr way it 
may. This method of conducting the association test yields 
i*es{)onyes that ofien ditTer widely from those obtained under 
insi nu t ions for speed, and it must be understood that the 
(‘oehicients (ibtnined from the frequency tables then possess no 
iieccosary correspondence with those obtained when the stand- 
ard luefhod is followed. 

(d) Follow the suagestkuis just cjted in Variation 2, with 
the additional proviso t])ai aS' may respond by a phrase or com- 
pound w-^ord in case tliat be the first verbal association that 
rises in his mind. It is instructive to compare the responses 
obtained under this A iifgalic with those obtained by the stand- 
ard method. Here, again, the calculated coefficients are not 
directly comparable with' those established by Eosaiioff with his 
tables and his instrnetions, though the method is, in the author’s 
opinion, a better one for deiermining the degree of individuality 
in associative tendencies?. 

Treatment of Data. — To determine tlie coefficient of com- 
monplaceness compare the responses for each one of the 100 
terms with the res[)onses listed in the Kent-Rosanoff frequ^cy 
tables; record the several ^index-values/ then average them to 
obtain the coefficient. Thus, if to table S responds chaiVj the 
index is recorded as 267, because 267 of the 1000 persons tested 
by Kent and RosanotT gave this response: if the association be 
table-hard^ its index is 9; if it be table-blade^ the index is 0, 
because no one of the 1000 persons chanced to give that re- 
sponse. The association table-blade and any other association 
which is not found in the frequency tables is termed an indi- 
vidual response, while any association found in the tables, 
whatever its index may be, is termed a common response. Any 
response that is a gi’ammatical variant of a term listed in the 
fables is classed as a doubtful response, e. /7., the association 
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tahU'inhy is doubtful since only table ink is found in the list 
for that stimulus word. 

The percentage of common, individual and doubtful re- 
sponses are then computed. If no re.spoiise is obtained (c. g,, 
“nothing,’’ “don’t know”), E may find it necessary to add a 
fourth class (“failures”) to the three classes just mentioned. 

The term common response is not entirely synonymous with 
the term normal response, because, obviously, the responses 
gathered from 1000 persons do not exhaust the possibilities of 
perfectly ^natural’ associations. To meet this difficulty Kent 
and Kosanoff have given in their appendix statements that cover 
in a general way the responses that are to be deemed hiormaP 
for each of the 100 stimulus \vords and also still more general 
rules to cover associations to any stimulus word. These expla- 
nations (10, pp. 126142) must be kept in mind whenever the 
question arises whether the responses of a given S, how^ever 
individual they may be, are yet within the bounds of normality. 

In certain oC the words in their list this restriction of the indexes to 
tliose responses actually secured from the ICKX) persons occasions a per- 
fectly obvious and rather unfortunate artiticialify. I'ake, for example, 
the word c/7// (No. 70), As a response to it, 12 different cities have been 
named, and w ith the most divers frequencies, c. //., A7 /o Vor/c, 91); Cleve- 
land, 1. It S chanced to respond In(1ia7iapoHs, he would have to he cred- 
ited w'ith an individual response, index 0. I w'onld suggest that in this 
case all names of cities he counted together and the name of any city ho 
given the resultant index, 124. Similar situations arisowidi other stinni- 
lus w'ords, like dot tor, square, child, ocean, etc., and with respect to the 
grammalical variants of many of the responses. Thus, for instance, the 
association man-woman has an index of 394, that man-women an index of 
0. There are numerous such cases in wdiieh a very slight modification of 
the response alters enormously its index value, so that changes in the 
assoeiation which would appear psychologically indifferent remove re- 
sponses from the realm of the commonplace and credit them with indi- 
viduality. 

Another criticism that might be raised against the use of tbe frequency 
tables in the maimer prescribed is that, the tendency toward common- 
plac'eness may be abnormally raised by the chance giving of a vei;y few 
responses whose index value is unusually high. To give the three re- 
sixmses tahle-ehair, dark-Uqht, soft-hard, alone, will give N 1059 points of 
commonplaceness, even if he should hapiicn to give an entirely individual 
response to every one of the 97 remaining terms. To meet this difficulty, 

s may be couqiared simply with respect to the number of common and 
of individual respouses they have given, or, as suggested by Bovet, by 
computing as an index of banality tbe number of terms to which the 
most common response Is given and as an index of originality the num- 
ber of unique responses. Still other methods have been suggested by 
Bovet. 
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In addition to computing the coeihcient of comitionplacenees, 
and the percentage of common, doubtful and individual re- 
sponses and failures, E may attempt a further classification of 
the resporses, and, indeed, he will find it quite desirable to 
^o so whenever the number of individual responses distinctly 
exceeds the ordinary number, or whenever other features of the 
responses indicate the possibility of some anonmly in the asso- 
ciative processes. For this purpose the classification and analy- 
sis published by Kent and Rosanoff in conjunction with their 
frequency tables will serve satisfactorily.* 

The following explanation may serve to assist in the use of 
this classification. 

(a) Whilfe coimiioii res[)Oi!ses are as a nilo also normal responses, 
there are certain ones of them that may ho tormod non-spe('ifie responseft, 
which, if present to an unusiiai degree, inay have some pathoiogical signifi- 
cance. A non-si)eciQc resi>onse is one wliioh has so wide an applioatioii as 
to be a possible associate for almost any stimulus word, e. (/., such noiins 
as thing, article, object, or such adje^/tivc^s as good, HjnaJl, u-wful, pleasant. 

Within the individual responses, in addition to individual non-specdfic 
responses (like those just mentioned, i)ut not in the frequency tables), 
there may be distinguished : 

(5) Resfiynses by sound, that lead to neologisms, i. c., eonstriictlou of 
new words, c. g,, man-manion, angcr-Angoria. 

(c) 'Neologisms without sound relation, as dark-unbrighi, deep-dept- 
ableness. 

id) Repetition of the preceding response. 

(c) Repetition of a response five times or over (stereotypy), as the 
response parent to the stimuli man. mountain, mutton, short, woman, 
cold, etc. 

if) Repetition of the preceding stimulus. 

(g) Response by derivatives, i. c., grammatical variants of the stim- 
ulus word, €. g.. short-shortness, swcct-sxcccicned. 

(h) Individual non-spanfic responses. 

<i) Responses by sound, W with actual words, c. g., man-manners, 
short-shorthand. 

(;) Word complements, L c., responses in which an addition to the 
stimulus word forms a word, name or comi>onnd term in ('ommon use, 
e, g., baby-hood, thirsty-hlood, grccn-Paris. 

(k) Responses by particles of speech, as articles, numerals, in’onouns, 
auxiliary verbs, adverbs of time, place and degree, conjunctions, preposi- 
tions and interjections, e. g., chair-down, eating-sometimes, soldi er-yours, 
whiskey -no. 

(7) Association to preceding stimulus, meaning a response not found 

^The prolonged dlsonssion concerning the most feasible and psycho- 
logically justifiable system of classifying responses In association tests Is 
too lengthy for consideration here. For some account of recent classifica- 
tions the reader may consult Wells (22) and Kelley (9). The idea of Kent 
and RhsanolBP has been to forego logical classification In favor of a strictly 
empirical and objective system. 
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In tbe frequency tables for the word that it follows, but found In them as 
a response for the preceding stinmlus, as In the pair of responses, thief- 
nighty lion^ 2 )ocketbook, 

(m) Association to preceding response, meaning a response not found 
in the tables for the word that It follows, but found in them as a response 
to the response given for the preceding stimulus (whether in direct or 
reverse order), as in the pair of responses, cating-idhle, mou7itain-floor , 

(n) Repetition of a previous response (distinguished from repetition 
of preceding response). 

(o) Repetition of a previous stimulus. 

ip) IndividuaL hut normal responses, according to rules given in the 
appendix. 

(q) Association to a preceding response (so judged by E, though 
neitlier res])onso cliances to be one of the 100 stimulus words), as in the 
pairs pricst-f other, occan-mothcr. 

(r) lJ7wlassificd icsjionscs — a rather large group in some types of 
pathological ^s’s, because of the presence of numerous incoherent responses, 
but also found witli norma! when tbe response is affected by distract- 
ing circinnstances, by purely personal experiences, etc. 

In using this classification, responses that might be listed in two or 
more categories are to be assigned to the one of them cited earliest in the 
above list. 

When times are obtained, the speed of each /Sf is best indi- 
cate d by the median, rather than by the average time of his 100 
responses. Similarly, the best indication of variability is found 
in the qiia^^tile variation, i. e., one-half of the difference between 
the 25th and the 75(li time, when the times are arranged in 
order from fastest to slowest. 

Results. — (1) Normal distribution into the three funda- 
mental categories of the Kent-Rosanoff system-*-common, doubt- 
ful, and individiial~is best indicated by the results obtained 
by these workers for the 1000 on which their frequency 
tables have been based. Their results are summarized in Table 
58, wherein the distribution obtained by them and by other 
workers for other types of iS’s has also been given to facilitate 
comparison. The point upon which most emphasis has been 
placed is the relatively small percentage of individual responses 
(6.-8) given by normal iSf’s. 

(2) Normal times for free association with the Kent-Rosanoff 
series have been reported by few experimenters. Miss Otis 
merely states that the times proved significant and valuable 
and that defective children were both slower and more variable 
than normal children. Goett (6), who used Jung’s list, found 
fhat with normal children the mode was in the 2d second and 



CO [^26] ASSOCIATIOI^^ LEARNING AND MEMORY 


TABLE 58 

Average Distributions for the Kent-Rosanoff Test {Conigilcd from 
Easlmatif Kcnt^ Rosanoff and Strong) 


EXPERIMENTERS 

S’a 

! AGES 

1 

COMMON 

doubtful! IND1VID*AL 

1 

Kent and Rosanoff j 

1000 normals 

8-80 

91.7 

1.5 

6.8 

Kent and Rosanoff 

247 insane — 

adults 

70.7 

2.5 

26.8 

Kent and Rosanoff ' 

82 man.-dep. 

adults 

75.8 

3.0 

21.5 

Strong 1 

16 man.-dep. 

adults 

78.6 

1.0 

19.7 

Eastman and Rosanoff 

253 delinq’t 

1U7 

84.0 

2.2 

13.2 


was not much affected by age, while with mental defectives the 
mode Avas in the 3d second. Kelley’s tests of 12 college stu- 
dents, with a list of 100 terms decidedly more diflBcult than the 
Kent-Rosanoff list, revealed a skewed curve with the mean 
slightly higher than the median, the median slightly higher than 
the mode; the mode was 1.0 sec., the minimal time 0.5 sec., the 
maximal time 3.5 sec. The author has found the average times 
for college students with the Kent-Rosanoff list to lie between 
1.00 and 2.75 sec. An average less than 1.5 sec. may be con- 
strued as a fast association time. 

(3) Dependence on age. That children give distinctly fewer 
common associations (and hence more individual associations) 
than adults is' the general conclusion of all experimenters 
(Reiniiold, Saling, Wreschner, Ziehen and the Rosanoffs), 
though Reinhold did not find the number of common responses 
to increase steadily from year to year, and the Rosanoffs be- 
lieve that the differences between children and adults are prac- 
tically obliterated after the age of 11. 

Their results, expressed in per cents., are shown in Table 59. 
Graphs of these distributions will be found in the original text 
(p. 49). The increase in the frequency of individual respohses 
at the age of 15 is attributed to the presence of a number of 
retarded pupils who were still members of a grammar school at 
this age. Failures to respond (sixth column), which include 
replies of ^^don’t know,” are found to be due usually to lack 
of familiarity with the stimulus words. While this conclusion 
is borne out by their detailed table of failures (18, p. 47), it 
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TABLE 50 

Dependence of Distribution in the Kent-Rosanoff Test on Age 
(Isabel Rosanoff and A, J. Rosanoff) 


AGE 

1 

1 COMMON RESPONSES 

Specific 1 Non-Specific 

1 

DOUBTFUL 

RESPONSES 

INDIVIDUAL 

RESf' NSES 

FAILURES 

TO RESPOND 

4 

40.4 ! 

1.1 

3.8 

25.3 

29.4 

5 

55.1 i 

2.0 

4.4 

21.4 

17.1 

G 

62.2 i 

2.7 

3.2 

18.6 

13.3 

7 

G4.9 

4.0 

3.5 

20.0 

7.6 

8 

68.4 

5.8 

3.1 ^ 

18.0 

4.7 

9 

75.1 

5.5 

1.7 

14.2 ! 

i 3.5 

10 

72.9 j 

8/4 

2.3 

14:3 i 

1 2.1 

n 

82.0 j 

l.l 

i 

8.6 

0.6 

12 

83.8 

Of, 

1.3 

7.6 

i 0.7 

13 

81.1 ’ 

8.4 i 

1.8 ; 

8.5 

0.2 

14 

84.1 

G.3 1 

1.4 ; 

7.7 

0.5 

15 j 

78.7 

7.G 1 

2.0 i 

10.8 ! 

0.9 

Adults! 

85.5 i 

0.2 ! 

1.5 i 

G.8 1 



must be borne in mind that occasionally even normal adults 
reply ^‘notliiiig/^ and again that young children often make no 
reply and yet subsequent questioning shows that they have had 
numerous visual and even verbal associates in lonsciousness 
lo which for one reason or another they have given no expres- 
sion. • 

A further analysis of these writers sheds some light upon the 
lelative preponderance in children (300 cases, 4-15 years old) 
as compared with adults (8(> normal cases, sele( led records 
containing not over 10 per cent, individual responses) of <‘cr- 
tain types of individual responses. liCference lo this analysis, 
reproduced in Table GO, shows that the greater pail of the excess 
individual responses given ]>y children fall in the cai(igori(‘s 
‘partial dissociation’ and ‘perseveration,’ while* (hi* individual, 
but normal resjionses (by appendix to the frequeru v tables) are 
acl^^ally fewer with children."* 

dn this analysis the term *j)arlial dissoeiation* enan’aecs what liave been 
described above as non-specific responses, responses by sound (including 
neologisms), word c^omplements and particles of speech, while the term 
‘perseveration' embraces all varieties of responses to earlier stimuli or to 
earlier responses and repetitions of responses more than five times. 
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These experimenters argue that ‘‘it would seem, then, that the 
tendency of children to respond with individual reactions more 

TABLE CO 

Individual Responses of Children and Adults in the KenURosanoff Test 
{Isabel Rosanoff and A, J. Uosanoff) 


TYPES OP RESPONSE 

86 NORMAL ADULTS 

300 CHILDREN 

Normal (by appendix) 

1 

41.8 

20.0 

Derivatives of stimulus words 

0.3 

! 0.1 

Partial dissociation 

8.0 

1 11.1 

Perseveration 

6.1 

27.8 

Neologisms (without sound relation). 


0.6 

Unclassified 

!| 4 ^ 

40.4 


often than adults rests in a large measure upon a certain lack 
of mobility of attention which results in an inability to quickly 
dismiss from the mind previous stimulus or n^aclion words and 
to turn the mind wholly toward the new stimulus word.’^ 

Tbe author is inclined to believe that here, as in not a few other in- 
stances ill which Children differ from adiiUs in psycliolo^ical tests, what 
we are really bringing to light is an iicibility of the children to understand 
the instructions or disinclination to follow them if they ;u*e understood. 
In other words, tlie regular instructions of the Kent Rosanoff test consti- 
tute an artificial restriction of tlie natural associative tendencies, as will- 
be shown furth^* on. Adults are able and willing to niaiiitaiii the proper 
attitude and follow the rules of the game; many children are unable or 
unwilling to do so. 

Again, as regards the perseverative tciidciicics, no instructions are given 
to tlie child to avoid repetition of association, while It is eommou for 
cultured adults to avoid repetition from some preconceived notion that 
they are called upon so to do. 

Moreover, while data are lacking to prove this contention, it seems very 
likely that the amount of ‘perseveratioiC wituo'^sed in responses to an 
association test is much influenced by the speed with which the entire 
test is conducted, because the faster the succession of stimuli, the greater 
the ‘hang-over’ effects of the words, whether stimuli or responses, that 
have hern in cohsciousness. Although precise statements are wanting, 
Rosanoff and his co-workers appear to have conducted their tests at a 
fast pace. It goes without saying that for purposes of comparison be- 
tween any groups of N’s, tbe speed of giving tbe stimuli should con- 
st aiit and that pauses for rest introduced with one group should be Intro- 
duced likewise with tbe others. 

A closely similar opinion is expressed by Kakise (8), when he says: 
*‘To sum up. these so-called characteristic forms in children and the ab- 
normal can all be found in normal adults in their natural associations, 
L c., when tbey react according to natural and spontaneous suggestions, 
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as was tljc case with our experiment, and do not react according to arti- 
ficial and ‘sophisticated’ associations, i, e.y by mere verbal associations, as 
is the case in ilie customary experiment with normal observers who are 
expert enough to oi)ey tlie ‘rules/ 

Another aihnnpt to establish relations be^^^een age and asso 
ciative type has been made by Miss Otis, who te ^ted 200 normal 
children, aged 4 to 8 years, 40 in. each of the 5 ages, and com- 
pared the results with those for 12»0 children in the Vineland, 
N. J., Training* School for the Feeble-Minded, classified for 
mental ago by the Btnet-Simon tests. 

TABLE 01 

Tyi)cs of .l.v.soc/(^//rc Rcfiponse hi 'Normal and Feeble-Minded 
Chilihen {Oils) 


Normals. 


AGE 

1 

1 FAILLHE 

T\PE I 

TYPE 11 

1 TYPE III 

TYPE IV 

TYPE V 

TOTAL. 

4 

1 1 

21 

4 

0 

11 

3 

40 

5 


G 

13 

1 

14 

ft 

43 

C 



2 

G 

13 


39 

1 

i 


2 

1 

8 

29 

40 

® 1 

1 

1 

* 1 

3 

5 

I 30 

40 

'l 

— 1 

— 

■ — 

1 j 

— 

1 — . 



All: 

1 

^ ! 

28 

1 

22 

1 

i 

51 j 

89 



202 


DelVct i VOS. 


AGE 

j FA I LUKE 

j Tvi’i: I 

1 iVPE 11 

1 

j type III 

j TYPE iV 

i "I 

j TYI'E V 

TOTAL 

2 

! 

4 



i 

i 

! 

4 

3 

1 

5 

1 



1 

7 

4 

1 

3 

1 


1 


5 

T) 

1 

1 



5 

1 

7 

0 

2 

3 

1 


9 

1 

10 

7 



1 


1 11 

G 

18 

8 


1 


1 

7 

19 

27 

9 , 




7 

15 

23 

10 





3 

1 14 

17 

11 






4 

4 

12 






4 

4 

— — 

— 

— 

— 

— 



... 

All 

2 

! 

17 

' ^.J 

i 

43 

1 65 

132 

1 
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III Tabic Gl, Type I siguiGes repetition of the stimulus, Type 
11 non-logical responses (no apparent conneetiou betweeir 
stimulus and response), Tyjie III responses by sound (whether 
by a real word or by a neologism), Type IV iniilti verbal re- 
sponses (like ivlmtlc — ichen you whistle^ doctor — to make you 
better, table — thcre^s a table), and Type V normal responses 
(meaning here responses by one word, of which at least 50 per 
cent, must be found in the frequency tables). A child is classed 
as belonging clearly to one of these five types only when at least 
50 per cent, of his responses are of the kind indicated, but the 
figures given in Table Gl include cases of bnixed^ types, which 
have been classed by the preponderant tendency. So far as 
normal children are concenied, it appears (1) that at 4 years 
more than half belong to the types characterized by repetition 
of the stimulus, (2) that non-logical responses (Type II) are 
characteristic of 5 years, (3) that multi verbal responses (Type 
IV) are very prevalent from 4 to G years, (4) that a normal 
type of response, in the sense here used, is established in 75 per 
cent, of children by the age of 8 years, though these children 
by no means respond like adults, or even like children of 12« 
when their detailed responses are taken into consideration. 

The relation of speed of association to age is not so clearly 
made out as one might expect. Nearly all experimenters find 
that work witjx the Kent-Rosanoff lists takes longer with chil- 
dren than with adults. Ziehen concluded that free association 
times decreased markedly year by year and Wresclmer reached 
a similar conclusion, but both (jioett and Rusk report that there 
is no definite relation between s^ieed and age, while Meumann 
calls attention to the fact that, though work progresses more 
rapidly with older children, the more intelligent not infre- 
quently res})ond more slowly, and the less intelligent, by reason, 
s(Kjmingly, of their relatively less originality and paucity of 
imagery, frequently respond more rapidly. In the limited mim 
her of tests made by the author, children (of about the anje of 
0) have invariably been distinctly slower than adults. 

(3) Dependence on sex. The results reported by Burt and 
by Burt and Moore show a number of inconsistencies; in one 
group at least (G5 children in the Holt School. Livei’pool) the 
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oiiis slightly exceeded the boys in number of associations writ- 
ten, while.iii another group (130 children, aged 13 years, in the 
Wallasey School) 35 per cent, of the boys exceeded the median 
of girls. Burt and Moore, in any event, conclude that “the 
males are far quicker than the females.” 

In tlieir compilation of data from 1000 normal &''s Kent and 
Kosanoff did not find any considerable differences between the 
sexes in the nature of the distribution of the responses. 

(4) Dependence on pTactisc. Both Rusk and Wells (23) find 
that practise in giving free associations reduces the time. Since 
this practise is not gained by actual repetition of the same 
series of stimulus words, the gain in time must lie in facilita- 
t ion of general factors that condition the process of associating. 
Wells finds that the responses become less emotional, that the 
number of supraordinate relations is diminished and that of 
simple laiigunge-motor responses is increased, while at the same 
time there is greater ^particularization^ in the responses. Ver- 
bal connections appear to become doosened up,^ and general 
linguistic readiness is augmented. The eft'ect of practise, then, 

"is to develop an easier, simpler and more superficial type of re- 
sponse. Practise also decreases the times, so that the median 
speed is reduced to about 1.2 sec. from any amount abo)#e that 
u]) to 3.0 sec., with the consequence that individual differences 
in speed are less after practise than before it. ^ 

(5) Dependence on intelligence. The original data collected 
by Kent and Rosanoff permit them to compare the responses of 
100 persons of collegiate education with those of 100 persons 
of common school education. The comi)arison indicates (see 
their Table i, p. 0) more individuality in the responses of those 
of collegiate education, but the authors deem it unsafe to risk 
a definite generalization to Uiis effect on account of the wide 
variabilily in individual records of both groups. 

In the case of children Isabel and A. J. Rosanoff compared 
21^du‘ight,’ 21 ^average/ and 21 ‘dulT children (teachei^’ esli- 
mates) and sec ured the results shown in Table G2. 

The same investigators contrasted 38 pupils who were peda 
gogically advanced with 38 pupils of the same ages who were 
pedagogically retarded, and found, similarly, that the retarded 
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TABLE 62 

Disirihutimi of Ilcsijonscs as Condithncd by Intelligence (Isabel and 

A, J. Tiosanoff) 


GROUP 

j COMMON 

DOUBTFUL j 

INDIVIDUAL 

FAILURES 

Bright — 

79.0 

» 1 

12.0 

5.6 

Average-- 

1 75.3 

2.7 

12.6 

9.4 

DuU 

1 66.9 

2.3 j 

22.0 j 

8.8 


pupils gave more individual responses (13.7 vs. 9.8 per cent.) 
and the advanced pupils more common responses (8G.9 vs. 81.G 
per cent.). They believe that extreme departure from the dis- 
tribution which is average for the age of the child in question 
is an indication of a fundamental difference in mental ability; 
that ‘plus-variations’ [exceptionally high i>ercentagc of common 
resi>onses?] characterize cases of precocity, while “minus- 
variations border on the pathological.” 

These conclusions are distinctly at variance with those 
reached by Ziehen, by Wreschner and by Meumann, all of whom 
iVnd a greater degree of originality, i, c., more individuality, 
in the associations given by more intelligent children. Other 
differences cited by Meumann (14, 89-101) are the following: 
(T) .the unintelligent more often misunderstand or misinterpret 
the stimulus word; (2) they mefre often fail to respond; (3) 
they give a grejfter number of incoherent and seemingly sem^e- 
less associations; (4) they more often use very ‘su})erfloiar con 
nections, such as grammatical variants of the stimulus, rimes, 
simple opposites; (5) they often give responses derived from 
phrases or verbal connections that they have learned in some 
school exercise; (G) they often exhibit an apparent precocity 
by giving responses like adults rather than the more concrete 
and pictorial associations that are characteristh^ of most chil- 
dren of their years; (7) thej^ tend to stick to certain forms of 
response once they have begun to use them (perseveration). 
Reinhold, on the other hand, found that in two of four clasps 
the better children showed more, and in the other two less orig- 
inality than the poorer children : he also argues that no differen- 
tiation between intelligent and unintelligent children can be 
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made on the basis of the tendency toward responses by sound, 
as this tendency is found on repetition of the test to be quite 
variable and a mere matter of chance attitude or ‘set/ Simi- 
larly, Wintcler, who sought to distinguish two types of re- 
sponse (the one termed the perceptual or describing, the other 
the comparing or relating type), could discern no relation be- 
tween intelligence and propensity to use these types. 

(6) Dependence on family relationship, Fili^st, who tested 
100 persons in 24 families with Jung's test words (7) and 
classified the responses under various categories, concluded that 
persons related to one another tend to exhibit more similarity 
in the use of these types than do persons not related. He also 
concluded that the associative type of children resembles that 
of their mother more than that of their father. 

(7) The feehle-niindcd. Miss Otis' results with Vineland 
children have been presented in Table Gl, where it is shown that 
repetition of the stimulns (Type I) is a common tendency 
with low-grade menial defectives, that multiverbal responses 
(Type IV) are encountered more often and persist till a later 
age in feet)Ie'minded than in normal children, and that normal 
I’esponses (Type V) appear later and less regularly in the 
feeble-minded. Goett deems the test of diagnostic value for ex- 
amining abnormal cliildren. He states that imbeciles have 
slower association times, tend to repeat responses and to give 
an unusually large number of multi verbal and non-specific re- 
sponses and ]'es])onses of the ‘jtredicative' type {wood—hurn, 
glass — hrcaL'lng). The 253 children examined h} Eastman and 
Bosanolf seem to have been ai least two years or more peda- 
gogically retarded. The rcvsults accord quite closely with those 
of Miss Otis and of Goett in that they reveal an unusiial number 
of non-specific responses, of repetitions of response, and of the 
use of particles. In addition, these investigators found a rela- 
tively large pro[)ortion of failures to respond, and a percentage 
of individual resnoni^es much above the average for normal per- 
sons, though not so gi*oat as in the insane (Table 58). On the 
other hand, really incoherent responses, senseless neologisms, 
etc., so frequent in the insane, were almost never giv^n by the 
feeble-minded. These authors point out that the conclusions 



08 [ 431 ] 


AS^>OCIATION^ LliAUNIiXG ANH ML’MOUV 


just cited iire true only for the group as a whole; a good inuiix 
of the children rated as feeble-minded or delinquent gave normal 
associations. When to this admission is added the demonstra- 
tion of Kakise, to which we have alluded, that multiverbal re 
spouses, repetition of the stimulus and other tendencies sup- 
posed to be characteristic of abnormal minds can also be found 
in normal adults, the value of the Kent-Rosanoff test as a device 
for diagnosis of individual cases is certainly much less evident 
than some of its friends would have us believe. 

(8) The insane. That the insane show a relatively high fre- 
quency of individual responses is shown by the work of Kent 
and Rosanoff and of Strong (Table 58). Kent and Rosaiioff 
have also shown by further analysis of their material (10, p. 
29) that there are characteristic differences in the distribution 
of the various forms of individual responses in the several dif- 
ferent forms of insanity, such as dementia praecox, paranoia, 
epilepsy, general paresis, manic-depressive insanity. A similar 
conclusion is reached by Ley and Menzeratli (12). The results 
obtained by Strong with IG cases of manic-depressive insanity 
show good agreement with those obtained by Kent and Rosanoil 
for 82 (*ases of the same sort. To what extent inferences mav 
safely be drawn from peculiarities iu the times of responses^ 
particularly from excessive slowness of reply, with res})ect to 
the ju'esence of hidded emotional com})lexes is a matier of muoli 
dispute.^ * 

(9) Dependence on instructions. Attention has already been 
‘called to the ditference in the outcome of the association test 
according as /S' is set to respond as quieldij as possible or as loell 
as jmssible.'^ It should be repeated that the conclusions drawn 
from the Kent-Rosanoff test with its frequency tables hold only 
when the instructions to respond by a jlingle word as quickly 
as possible arc si riel ly followed. In illustration reference 
may be made to the author’s own responses, taken under Varia- 

goncriil idea of tins problem may be gained from the references hero 
cited from Jiing, I.ey and Menzoratb and Levy-Sub 1. 

•Consult Meumann (13, 420 ff.) for further analysis of possible instruc- 
tions for this test, Hoels (17) has also called attention to tbe fact 
that despite uniformity of instructions, do adopt different attitudes 
toward the test and thus give different times and responses. 
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tiou of Method No. 3 (leisurely response with permission to use 
phrases when such did appear first in consciousness). Three 
alterations are prominent when the responses are compared 
with those by the standard instructions, (a) The number of 
individual responses is decidedly increased, so that the coeflS- 
cient of commonplaceness falls from 12.8 to 10.5 (reckoned in 
terms of the mean) or from 7.0 to 3.0 (reckoned in terms of the 
median). Striking examples are the following: 


STIMULUS 

QUICK RESPONSE I 

1 i 

COEFFICIENT 1 

LEISURELY RESPONSE 

COEFFICIENT 

soft 

hard 

365 

> pedal 

G 

needle 

thread 

i 160 

1 stic^kpin 

0 

religion 

faith ' 

47 

ecstasy- 

0 

whiskey 

i rye 

9 

rotten 

0 

city 

town 1 

i 1 

258 

voleur* 

0 


(h) There are numerous responses by phrases, and, further- 
more, comparison of these phrases with the single-term re- 
sponses under standard instruction shows that the single terms 
were really picked out from the phrase that was rising in con- 
sciousness. That young children may not always stop to make 
this selection is the evident explanation of the tendency seen 
in Ihein to respond by phrases, even despite repeated instruc- 
lions to the contrary by E, The following examples will make 
this point clear : 


STIMULUS 


lion I 

command | 

justice I 

child j 


QUICK RESFONSE LEISURELY RESPONSE 


beast 

order 

peace 

father 


king of beasts 
yours to command 
justice,^ peace and mercy 
child is father to the man 


(c) There are numerous indications of ‘perseverative’ tend- 
encies, especially in the use of the same response for a number 


•By way of the phrase : “the city is fuil of thieves” and thence to the 
French for thief— an excellent Illustration of the complexity of the 
process that may intervene before It is possible to ejaculate an oral 
response, and of the fact that the dropping of nil Introspective reports 
must rob the test of’mncb of its interest. 
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of different stimuli, as soft-pedal^ smooth — soft, hard — soft, 
loud — soft pedal, quiet — soft pedal. 
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TEST 34 

Controlled association: logical relations. — These tests differ 
from the preceding test of association in that they demand the 
ginng of a response which is so restricted that only a very 
limited number of terms may be deemed correct associates. 
There are, of course, numerous forms of controlled association, 
since numerous logical i-elations may be demanded between 
the stimulus words and the responses. The relations that have* 
received most attention in the literature of mental tests are 
part-whole, gcnus-species (subordinate) and opposites. Other 
less often used relations are whole-part, agent-action (subject- 
verb), action-agent (verb-subject), attribute-.substance (ad- 
jective-noun), substance-attribute (noun-adjective), cause-effect, 
effect-cause, species-genus (supraordinate), co-ordinate and 
mixed relations. 

Just precisely what mental capacities are measured by these 
tests is not always clear. Of course, it may be said roughly 
that they call forth the “ability to appreciate relationships and 
to fcontrol associations.” It is also evident that the skill in 
handling these various relations is based upon Vihat is known in 
psychology as a “determining tendency,” or “adjustment to 
react according to int.i ructions,” and that “the more completely 
this adjustment dominates ilie performance, facilitating the 
right responses and inhibiting other, interfering associations 
and perseverations, the leas hesitation and confusion will occur 
and the more prompt will be the reaction.” 

On the other hand, an obstacle both to designating the ca- 
pacities measured and to evaluating the results of these tests 
lies in the selection of the stimulus words themselves, for, if 
the terms art ten diSBcuIt, failures appear due to lack of famil- 
iarity with ilicir meaning or with the meaning of the terms 
connected with t-aera in various logical relations; while, if they 
are too simple, ng 'thinking’ is demanded and the responses are 
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given well nigh automatically. Moreover, the inclusion in a- 
list of terms of one or ihoi*e stimuli that arc markedly different 
from the othei's in this respect introduces a source of difficulty 
in administering the test that is hard to meet, especially in 
group tests. The only solution of these difficulties is to discover 
by comprehensive testing what might be ‘termed the ^association 
value’ of each stimulus word for /Sf’s of a given sex, age, intelli- 
gence, etc., and then to prepare standardized lists of stimuli 
suited by their like association values to the measure of con- 
trolled association in specified types of fif’s. Much has been 
accomplished in this direction, but much still remains to be 
done., 

Consideration of the yarious possible forms of controlled 
association is limited in what follows mainly to the most-used 
relations, part-whole, genus-species, and opposites.' 


A. THE PART-WHOLE TEST 


Materials. — (1) For individual tests: Split-second stop- 
watch. Set of 20 cards (and 3 samples), each containing a 
stimulus word. Paper for recording times, responses and re- 
marks. (2) For group test : Stop-watch or special seconds clock. 
Printed form containing the same stimuli and provided with 
spaces for the recording of the 20 associates. 

c 

The terms incorporated in these cards and in the forin are those rec- 
ommended by Woodworth and Wells as the result of nmiierous efforts 
at standardization. Cards are used, however, instead of the narrow 
cardboard sti'ip of these authors in order .that the time of each response 
may be measured by itself. The paper form is used to admit of written 
group tests. 

The terms proposed by Pyle for this test are : window, leaf, pillow, 
button, nose, smokestack, cogwheel, cover, letter, petal, page, cob, axle, 
lever, blade, sail, coach, cylinder, beak, stamen. His supplementary list 
is the same as that of Woodworth and Wells. 

The 10-word lists used by Rusk w’^ere : ear, wheel, beak, inch, platform, 
mast, branch, kernel, funnel, buckle: alternatives, moMth^ handle, claw, 
ounce, pavement, sail, stem, core, boiler, knob. 

The ten terms employed by Miss Norsworthy were : door, pillow, letter, 
leaf, button, nose, cover, page, engine, glass. 

The ten terms employed by Wyatt are not specified by bim. 


*The mixed relations or analogies test is dealt with separately as Test 
S4A. For further details concerning other tests of logical relationship, 
consult Rusk (15), Watt (20) and Woodworth and Wells (22). 
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Method. — Instruct S as follows : ^^Each. one of these cards 
has printed on it a word. As soon 1 uncover a card I want 
you to look at the word on it and then, as quickly as you can, 
say aloud the name of the whole thing of which that word is a 
part. The word you read is a part : you are to name the whole. 
For example, if the card should have the word fur on it, you 
might say cat or seal or fox. We will try these sample cards 
first to make sure you understand.” 

After a warning ^now’ remove the covei card from the top of 
the pile and take time for the first sample — button. Follow 
with the other samples, leaf and drawer. These cards are dis- 
played and the time taken just as in the test proper, in order 
to accustom S to the regular procedure. Misunderstandings 
are, of course, corrected and cleared away. 

Proceed with the 20 standard test cards. Record on the blank 
sheet of paper the times, in tenths of a second, together with 
responses and any comments that suggest themselves. Each 
card is provided with its own cover-card. They are best re- 
moved with the left hand and the watch started simultaneously 
with the right. It is recommended that the split-second W'atch 
be used, so that one hand may be stopped when 8 first re- 
sponds; then, if his response chances to be wrong, say ^No, give 
me another/ and take the time of his second attempt with the 
other hand of the watch. In this event, both times and both 
responses are recorded. • 

Variations of Method. — (1) Individual testing may also be 
carried out, especially if none of the terms is likely to cause 
unusual delay, by giving 8 the printed form provided for group 
tests and taking his total time for naming or^ally the entire 
series of responses. 

(2) For a group test by the w^ork-limit method® (which is 
recommended for ^^s who are competent to i*ecord their owm 
time) use the printed forms and the special seconds clock, after 
the samples above mentioned have been displayed on a black- 
board and discussed with the 8's. The clock is started at the 
signal for turning over the forms. Each 8, of course, makes 
his own written record. 


*See Vol. I, p. 8, Section (7). 
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(3) For a group test by the time-limit method use the same 
forms and stop all at a time-limit so chosen on the basis of 
preliminary trials with of that grade of ability that the 
fastest S shall roach about the IGth term on the list.^ It is 
hardly necessary to state that the scores obtained by either 
group test are not directly comparable with those obtained by 
the individual method. 

Tiikatment of Data. — (1) In the individual test the best 
indication of speed is furnished by the median. For a measure 
of variability the semi-quartile variation may be used, i. one- 
half the difference between the 5th and 15th time, when the 
series of times is arranged in order from fastest to slowest. If 
the arc competent, the errors will ordinarily be negligible, 
so that performance may be measured in terms of speed alone. 
If it should hapx)en that differences in speed are slight, while 
qualitative differences are well-marked, speed may be neglected 
and performance rated in terms of quality, as by scoring 1 for 
each well-chosen associate, 0.5 for each ^partly right’ associate, 
and 0 for wrong associates or omissions. If both speed and 
correctness need to be considered, some of the methods sug- 
gested in the cancellation test (No. 26) or in the opposites test 
(below) may be employed. 

(2) When individuals are tested by recording the total time 
for the entire list (Variation 1), errors may again be neglected 
if few and of slight iffoment; if more serious, the time may be 
increased by adding to it a penalty figured on the basis of the 
average time taken to utter a correct response to each stimulus 
omitted or responded to wrongly. 

(3) In group tests by the w^ork-limit method, performance 
may, similarly, be taken in terms of total time, or of correct- 
ness, or of some combination of time and correctness. 

(4) In group tests hy the time-limit method, the simplest 
method of scoring is that of crediting 1, 0.5 or 0 for each rc- 

®The lists of terms In these tests of controlled association have been 
so arranged by Woudwortb and Wells that the terms lying between the 
Slh and the 16tb represent as nearly as possible stimuli of equal difficulty. 
Thirty sec. will suffice for testing competent adults. Pyle recommends 
60 sec. for Grades 2, 3 and 4; 45 sec. for other grades (and 30 sec. for 
adults?). 
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sponse^ as above explained. If necessary to compare the per- 
formances of groups that have had different time-limits, they 
may be related by computing them all as if 60 sec, had been 
assigned, e. g,y by multiplying the score of adults by 2, etc. 

Results. — (1) Norms of performance in the part-whole test 
are supplied chiefly in the data published by Woodworth and 
Wells, by Miss Norsworthy and by Pyle. Tests of adult college 
students by the first-named authors show that the average asso- 
ciation time for this variety of controlled association (Varia- 
tion of Method No. 1) may be taken as 1.53 sec., P.E. .06, with 
a range for different individuals of from 1.03 to 2.50 sec. The 
median times reported by Rusk for 22 children, aged 7 years 
6 months to 14 j’ears 9 months, under Meumann^s instruc- 
tions (emphasizing quality rather than speed) range from 1.6 
to 5.0 sec. Miss Norsworthy’s norms, based on 504 cases, rep- 
resent results with her list of 10 words, no time-limit, scored in 
terms of number of correct associates. Pyle’s norms are based 
upon his list of 20 words, scored in number correctly written 
in a group test, computed on a basis of 60 sec. time-limit. 


TABLE 63 

Performance in the Part Whole Te^t or % worthy) 


AGE 

B 


10 

11 

12 

1 ^ 

14 

15 

16 

ADULTS 

Median 

P. E. 

. 6.5 
. 2.8 

7.8 

.1.8 

7.8 

1.9 

a? 

1.1 

8.7 1 
1.2 

1 

9.0 

0.7 

9.0 

0.7 

9.0 

OJ 

9.0 

0.7 

10.0 

0.5 

TABLE 04 

Correct Asiociaies Written In 60 Bee. Part-Whole Test (Pple) 

BEX 

AGE 

8 

3 

10 

11 

12 

13 

14 

16 

16 

17 

18 

ADULT 

Male 

female 

Cases 
Aver. 
A. D. 

Cases 
Aver. 
A. D. 

31 1 

5.5 

3.6 

43 ( 

4.6 

2.6 

57 

6.5 

2.9 

M 

5.9 
2.4 

70 

7.5 

21 

88 

7.^ 

|2i 

65 

1 8.9 
i 2.8 

67 

J10.0 
)\ 3.5 

76 

8.9 

3.4 

87 

10.0 

3.7 

77 

11.1 

4.3 

71 

10.8 

8.5 

62 

122 

4.1 

63 

12.5 

3.2 

42 

14.8 

5.5 

48 1 
14.0 

4.5 

35 

15.9 
52 

51 

16.9 
4.5 

12 1 
152 
4.0 

38 

162 

4.8 

23 
Il9.3 
! 5.6 

28 

19.7 

4.6 

J 

66 

18.5 

3.6 

87 

19.7 

3.4 
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(2) Dependence on age. The results obtained by both Pyle 
and Miss Norsworthy show that j^erforniance in this test im* 
dergoes a fairly steady improvement from 8 to 18 years. The 
lack ot any correspondence betw een speed and age reported by 
^usk is probably due to the small number of cases examined 
by him. 

(3) Dependence on sex. Scx-ditferences are not sutBciently 
evident to warrant conclusions, though it may be surmised that 
girls and w’omen tend to be slightly superior to boys and men. 

(4) Dependence on intelligence. Wyatt found a fair degree 
of correlation with intelligence (0.G7, P.E. .07 in one group 
using teachers’ estimates, and 0.5G, P.E. .08 in another group, 
using class examinations as the basis for intelligence). 

(5) FeeMe^minded. The work of Miss Norsworthy shows that 
mentally defective children are distinctly inferior to normal 
children in this test: thus the percentage of normal children 
with a record above the median, above — 1 P.E., and above 
—2 P.E., would, of course, be 50,. 75, and 91, respectively, but 
the percentages of feeble-minded children obtaining these three 
grades of efficiency were but 9, 17, and 27, respectively. That is, 
only 9 per cent, of the feeble-minded children reached the de- 
gree of efficiency attained by one-half of the normal children, etc. 

(6) Other correlations. Wyatt obtained with his Group I a 
moderately satisfactory coefficient of reliability, 0.G5. His 
correlations with other tests range from 0.09 to 0.77. The 
lowest correlation was with the letter-squares test; the higher 
correlations appeared with analogies (0.67), the completion test 
(0.75) and word-building (0.77). 

B. THE GENUS-SPECIES TEST 

Materials. — (1) For individual tests: Split-second stop- 
watch. Set of 20 cards (and three samples) each containing 
<a stimulus w^ord. Paper for recording times, responses and re- 
marks. (2) For group tests: Stop-watch or special seconds 
clock. Printed form containing the same stimuli and provided 
with space for recording the 20 associates. 
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These 20' terms are those recommended by Woodworth and Wells, 

The 10 terms used by Miss Norsworthy are: book, tree, room, toy, 
name, dish, boat, game, plant, fish. 

The 20 terms proposed by Pyle are: mountain, city, weed, metal, fur- 
niture, machine, author, planet, river, book, ocean, fruit, country, animal, 
bird, food, lake, tool, fish, money. His supplementary list is the same as 
Woodworth and Wells. 

The 10-word lists used by Rusk were: tree, fish, college, battle, picture, 
tool, hero, lesson, taste, wrong: alternatives, bi^ 1, leaf, game, poem, song, 
toy, hobby, book, smell, virtue. 

Method. — Instruct S as follows: “Each one of these cards 
has printed on it a Avord. As soon as I uncover a card, look at 
the word on it and then, as quickly as you can, say aloud the 
name of some particular thing that belongs in the class that 
is given on the card. The word you read is the name of a class 
or genus ; you are to name an example of that class, a species of 
that genus. For example, if the card should have on it the 
word taste^ you might say stccet or salt^ or if the word verh, 
you might name any verb like run or go. We will try three 
sample cards first to make sure you understand.’^ Follow the 
procedure outlined for the part-whole test in regard to the use 
of the sample cards, timing, etc. 

Variations of Method. — Follow the suggestions. given for 
part-whole test, save that here the samples will be b/rd, dish 
and game, 

T’reatment of Data. — Follow the suggestions given for the 
part-whole test. • 

Results.— (1) Tests of adult college students by Woodworth 
and Wells (Variant Method No. 1) show for the genus-species 
test an average association time of 1.84 sec., P.E. .07, with a 
range for different individuals of from 1.20 to 2.63 sec. The 
medians reported by Rusk for 22 children from about 7 to 15 
years of age, with quality emphasized more than speed, range 
from 1.6 to 11.4 sec. The norms reproduced here from Miss 
Norsworthy are based on 511 cases and represent performances 
made with her list of 10 words, no time-limit, scored in terms 
of number of correct associates. The norms reproduced from 
Pyle are based on his list of 20 words, scored in terms of num- 
ber correctly written in a gi'oup test, computed on a basis of 
60 sec. time-limit. 
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TABLE 6B 

> Performance in the Genus-Spedes Test (Norsworthy) 


. AO# j 

8 

1 

9 

1 

xo 

11 ' 

12 

13 

14 

15 

16 

ADULTS 

Median 

5.0 

5.0 

7.0 

9.2 

92 

9.3 

9.3 

9.5 

9.5 

10.0 

RE. 

i 

2.0 

2.7 

2.9 

1.9 

0.7 i 

1 

0.4 

0.5 

0.5 

04i 

0.0 


TABLE m 


Vorrect Associates Written in 60 Sec. Genus-Species Test {Pyle) 



AGE 

8 

9 

1 

10 

11 

12 

13 

14 

15 

16 

17 

18 

ADULT 


Cases 

b 

67 

66 

62 

69 

68 

64 

41 

33 

18 

16 

65 

Male 

Aver. 

4.6 

5.7 

6.5 

72 

7.1 

10.0 

10.5 

11.1 

15.2 

14.0 

17.3 

15.1 


A. D. 

1 3.4 

3.4 

3.7 

3.3 

2.5 

3.8 

1 3.8 

‘5.4 

4^ 

4.1 

6.0 

4.0 


Cases 

34 

65 

84 

63 

81 ' 

64 

55 

40 

45 

32 

25 

86 

Female 

Aver. 

5.5 

5.4 

7.8 

8.2 

1 9.3 

9.5 

11.8 

14.0 

16.4 

16.0 

16.3 

15.5 


A. D. 

1 

3.6 

2.5 

3.2 

3.7 

2.9i 

1 

3.2 

1 

3.2 

4.2 

5.4 

4.9 

5.3 

3.8 


(2) Dependence on age. Though Busk can find no definite 
relation between speed and age in the genus-species test, the 
figures reported by both Pyle and Miss Norsworthy show a 
general improvement with age, despite certain exceptions. 
]\Iiss Norsworthy^s test was obviously too easy for ages of 11 
and above, so that any tendency toward improvement beyond 
11 was obscured. Busk’s negative result is explicable partly by 
liis instructions against haste and partly by the small number 
of cases he tested. 

(3) Dependence on sex. Pyle’s averages make it reasonable 
to assume a slight superiority of girls over boys, since they 
show this superiority in ten of the age groups. 

(4) Fechle-minded children, according to Miss Norsworthy’s 
results, are distinctly inferior in this test to normal children 
of the same age * only 1) per cent, reach the median of the normal 
children; only 16 per cent, reach —1 P.E.; only 17 per cent, 
reach — 2 P.E. of normal children of their age. 
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C. THE OPrOSITES TEST 

Materials.— (1) For individual tests: Split-second Stop- 
watch. Two sets of 20 cards each (cxi liisive of samples)^ one 
set of easy, and one of moderately difficult stiinulns words. 
Paper for recording times, responses and remarks. (2) For 
group tests : Stop-watch or special seconds clock. Printed forms 
containing the same stimuli (one for easy and one for difficult 
words) and provided with spaces for recording the 20 Asso- 
ciates. 

The opposites test has been extensively used and has appeared in a 
variety of forms. Tlio most common lists arc printed herewitli. They 
demand a few words of explanation. 

Lists I, II and III represent the standardized lists for easy opposites 
prei)ared by Woodworth and Wells: Lists I and II, which are those used 
by Bri^^RS (his Tests 43 and 44) arc presumed to be of canal ditliculty 
and to„ be so arranged that the last half is just as ditlicult as the first 
half; List III, wliicli is the sot of easy oi)posites here recommended, 
is a selection of the 20 easiest opposites in Lists I and IL 


MATERIAL USED BY VARIOUS INVESTIGATORS IN THE OPPOSITES TEST. 


I 

II 

III 

IV 

V 

long 

north 

high 

good 

best 

soft 

sour 

summer 

outside 

weary 

white 

out 

out 

quick 

cloudy 

far 

weak 

white 

tall 

patient 

up 

good 

slow 

big 

careful 

smooth 

after 

yes 

loud 

stale 

early ’ 

above 

above 

white 

tender 

dead 

sick 

north 

light 

ignorant 

hot 

slow 

top 

happy 

doubtful 

asleep 

large 

wet 

false 

serious 

lost 

rich 

good 

like 

reckless 

wet 

dark 

rich 

rich 

join 

iiigh 

front 

up 

sick 

advance 

dirty 

love 

front 

glad 

honest 

east 

tall 

long 

thin 

gay 

day 

open 

hot 

empty 

forget 

yes 

summer 

east 

war 

calm 

wrong 

new 

day 

many 

rare 

empty 

come 

big 

above 

dim 

top 

male 

love 

friend 

dimcult 
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VI 

VII 

VIII 

IX 

day 

great 

succeed 

tender 

asleep 

hot 

strict 

animated 

absent- 

dirty 

tardy 

proficient 

brother 

heavy 

sleepy 

impoverish 

best 

late 

suspicious 

cruel 

above 

flist 

rigid 

generous 

big 

left 

suave 

haughty 

backwards 

morning 

sinful 

silly 

buy 

much 

conservative 

insignificant 

come 

near 

refined 

disastrous 

cheap 

north 

pride 

miser 

broad 

open 

despondent 

result 

dead 

round 

imaginary 

hindrance 

land 

sharp 

beautiful 

strength 

country 

east 

injurious 

Innocent 

tall 

known 

diligent 

busy , 

son 

something 

sell 

remember 

here 

stay 

sure 

increase 

less 

push 

active 

preserve 

mine 

nowhere 

venturesome 

belief 


List IV, one of tlie oldest and most employed, appears In several pub* 
lisbed articles and texts by Thorndike; it forms one of Simpson’s easy 
oi)posites, has been used by Miss Norsworthy in an extensive study, and 
constitutes the regular test list prescribed by Pyle. The opposite of 
this list, i. (?., bad, inside, etc., has been used by Bonser, by Miss Nors- 
worthy and by Mrs. Squire. 

List V is proposed by Pyle as harder opposites for use with adults. 

List VI has been used by Bonser, by Mrs. Squire and (with two 
changes) by Simpson. 

List VII has been used by Bonser, by Mrs. Squire and (with some 
cliunges) by Simpson and by Carpenter. It also appears in Thorndike’s 
tests. 

Lists VIII and IX are two of four hard opposites used by Simpson. 

The easy opposites test may be regarded as fairly well standardized 
so far as choice of material is concerned. But List III, which has been 
selected as best for younger children, will prove too easy for most /S’s 
of 10 years or over, and we have, no lists of moderately difficult and very 
difficult opposites that have been tested by very extensive experimenta- 
tion. The set proposed by the author has been selected from the 50 
terms used by Ilolllngworth, who, in turn, selected them from a list of 
200 tested by Woodworth and Wells and showing association times of 
from 2 to 5 sec. The attempt has been made on the basis of the author’s 
trials with college students and with the assistance of Dr. Hollingworth 
to select 20 hard opposites that shall be relatively easy to score and that 
shall be of closely similar difficulty. 

Method. — Use the easy opposites for younger children, the 
more difficult ones for children over 10 or thereabouts and for 
adults. Instruct S as follows : ^'Each one of these cards has 
printed on it a word. As soon as I uncover a card, look at the 
word on it and then, quickly as you can, say aloud a word that 
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means just the opposite to it. For instance; if the card should 
ha\:e on it the word clirii}^ vou would say clean. We will try 
tliree sample cards first to make sure you understand.^^ With 
the hard oj»posit(s follow the procedure outlined for the i)art* 
whole test with regard to the use of the sample cards, timing, 
recording responses, etc. 

Variations of Method. — Follow the suggestions given for 
variations of method in the part-whole test, with due regard for 
changes in sample terms, etc. 

AVlien the harder opposites are used, particularly with adults, 
the instructions may be altered do put special stress upon the 
giving of an exact o])posite, i. c., the emphasis may be placed 
111)011 (piality rather than upon speed of performance. Further, 
it is well to instruct aV that opposites formed by the use of the 
prefixes nn or in, or of the suffix less, will not be allowed, save 
when the root of the stimulus word is changed; thus, for in- 
stance, inharmonious would not be accepted for harmonious, 
nor unsafe for safe, but harmless would be accepted for dan- 
(jerous. The split-second watch may then be used to advantage 
by rejecting responses that are incorrect, and recording the time 
of various I’csponses made before the proper one is given. 

To test the effect of practise, the cards may be shuffled and 
the series repeated any desired number of times, a^ in the pro- 
cedure adopted by HoIIingworth in his tests of the effect of 
caffein. 

Treatment op Data. — This may follow the directions given 
for the part-whole test. With older children and adults, how- 
ever, when the instructions have emphasized quality rather than 
speed, the scoring of responses should be decidedly rigorous, 
and it may be well for many purposes to permit only a single 
correct opposite and allow nothing for ‘partly correct^ re- 
sponses.^ 

*Mrs. Squire counted as errors all responses that were not accurate 
and gave no credit for adverbs when adjectives were correct, nor even 
for approximate opposites, urging that “there Is no mental test In which 
.an approximate is Jess permissible.” 

The important thing is, of course, that E should settle upon the type 
of mental activity that is to be demanded (speedy approximate re- 
sponses or rigorous precision) and then adjust Instructions and scoring 
to measure this aspect of the associative process. In using the cards 
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Results, — (1) Norms. The average time of response of adult 
college students is given by Woodworth and Wells as 1.11 sec., 
P.E. .04, range 0.85 to 1.40, for the easy list. The norms ob- 
tained by Pyle, Miss Norsworthy, Mrs. Squire and Carpenter 
are reproduced in Tables 67, 68, 69 and 70, respectively: these 
figures may not oe compared directly with one another on ac- 
count of difi'ereuces in materials, scoring and other conditions, 
but they will serve as bases for conclusions with regard to the 
dependence of performance in the test upon age, sex and other 
factors. 

Pyle’s uorins represent the average number of opposites that could be 
written in GO sec. in a group test, using a list formed of the opposites 
of List IV, above. 

Miss ^Norsworthy’s figures refer to the number of correct associates 
to the opposites of List IV (her First List) and to List IV itself (her 
Second List), given by about Gil normal cbildren of both sexes. Here 
the niaximal possible score is evidently 20. 

Mrs. Squire’s figures show the average lime in sec. and the average 
number of correct responses (rigid scoring) for small groups of peda- 
gogically unretarded children for three separate lists (our Lists Vlf VII 
and the opi)osites of IV, respectively). For the standards proposed by 
her for each age, see the original article, pp. 500-50G. 

Carpenter’s results are based upon what he describes as practically 
the same terms as our List VIL The figures show the errors and the 


TABLE G7 


Correct Associates Written in 60 Sec. Opposites Test {Pyle) 


SEX 

AGE j 

8 

9 j 

10 

11 

12 j 

13 

14 

15 

16 

17 

18 

ADULT 


1 

Cases 

33 

65 

60 

1 1 

61 1 

72 

U' 

61 ' 

40 

33 

17 

22 

62^ 

Male 

Aver. 

9.0 

8.4 

7.5 

10.9 

ill.514.5 

*14.5 

16.0 

18.6 

17.6:22.4 

22.1 


A, D. 

3.3 

3.0 

3.1 

2.9 

2.9 

4.5 

j 4.3 

5.2 

5.3 

3.3 

3.2 

3.3 


Cases 

33 

56 

77 

65 

74 

|73 

58 

49 

48 

27 

26 

85 

Female 

Aver. 

8.0 

7.6 

110.9 

11.2 

13.9 

14.9 

17.4 

17.3 

19.3 21.4 23.4 

23.4 


A. D. 

4.0 

2.9 

j.. 

3.0 

3.6 

4.3 

3.9 

5.1 

4.2 

4.9 


4.0 


for individual testing it will be found couvenieiit to list upon the back 
of each card the diFerent words that are given by ^’s, together with the 
score previously determined upon for each word. 

For a more elaborate system of equating speed and quality of work 
the reader may consult Simpson (IG, pp. 14, IG). 

The work of Woolley and Fischer contains many valuable suggestions 
for the evaluation of various responses in the opposites test (see 22a, 

pp. .210-221). 
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time -In see. obtained In individual tests In which the terms were read 
by E and responded to orally by iS?. Ilis records are confessedly “of little 
value below age 9.” Since the times were taken with an ordinary watcli 
and merely express the total time occupied by the test for each child, 
it is impossible,, of course, to derive from them any precise idea of the 
association timej strictly speaking. 


TABLE (ks 

Correct Associates of a Possible 20. Opposites Test- (Norsivorthy) 


I.1«T j 

AGE j 

8 1 

9 

10 j 11 

“1 


14 

15 

16 

ADULTS 

Opp. of IV, 

Median 

7.4 

1 I 

9.0 

1 !' 

9.9,12.5 

I 13 . 5 ! 

14.0 

i 1 

14.5il5.0i 

1 

15.51 

20.0 


P. E. 

2.0 

2.0 

3.0 3.0: 2.6 

2.5 

2.3 

! 2.3 

2.3 

1.0 

IV. 

Median 

8.7 

9.5 

11.513.1114:7 

16.4 

17.8 

18.5 

19.0 

20.0 


P. E. 

L4 

1.7 

2.2; 2.9; 3.6 

i 1 

2.4 

2.0 

j 2.0 

2.0 

1,0 


TABLE GO 


Correct Associates uad Times. Opposites Test (Squire) 


AGE 

LIST VI 

LIST VII 

LIST IV (OPP.) 

AVER. FOR ALL 

Words 

Time 

Words 

Time 

Words 

Time 

Words 

Time 


B 

8.5 

192.3 

11.3 

143.3 

11.6 

120.0 

10.5 

151.8 

7 

13.1 

155.6 

15.0 1 

137.7 

14.5 

117.6 

14.2 

136.9 

8 

16.1 

110.3 

17.1 

98.2 

16.7 , 

104.9 

16.6 

104.8 

9 

17.6 

103.7 

16.5 

101.1 

17.7 

98.4 

17.2 

101.7 

10 

17.1 

87.1 

17.7 

87.0 ; 

18.2 

76.2 

17.6 

83.4 

n 

19.3 

79.3 

19.0 1 

102.0 1 

19.6 

68,3 

19.3 

83.2 

12 

19.5 

81.2 

19.2 

85.5 

19.2 

63.2 

19.3 

63.2 

13 

19.4 j 

i 1 

72.5 

19.2 

61.5 1 

19.2 

65.0 

19,3 

1 66.3 


TABLE 70 

Errors and Times, Opposites Test (Carpenter) 


AGE 

7 

* 1 

9 

10 

1 

1 

12 

13 

14 

Cases 

7 

19 

46 

50 

41 

f 

44 

58 

49 

Aver. Tinie 

118 

118 

108 

101 

98 

82 

79 

71 

Aver. Errors — 

4.1 

4.2 

i 

4.5 

i 

4.7 

4.8 

3.8 

3.6 

3.2 
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(2) Dependence on age. The evidence from these four tables, 
as well as from the 'results of Woolley and Fischer, though 
not guaranteeing in every instance a uniform increase in. 
quantity or quality of i^erformance from year to year, iiii' 
doubtedily jiistifier the generalization that both speed of find- 
ing opposites and accuracy of the responses made, improve 
with age. The failure of this tendency to appear in the tables 
published by Bonser is apparently due to the inadequacy of his 
test material for bringing out the abilities of the older pupils. 

(3) Dependence on sex. In all comparisons of groups the 
superiority of females over males is readily noted. Thus, girls 
surpass boys in 10 of Pyle^s 12 age-groups; Hollingworth (9) 
found women faster than lUen in naming opposites both before 
and after practise; Burt and Moore report that in one group 
only 29,2 and in another only 42,2 per cent, of the boys reached 
the median mark of girls ; Bonser found girls superior to boys 
in every school grade,' though it is significant that in most of 
his groups more boys than girls were found in the highest 
quartile. Woolley and Fischer report a slight superiority of 
girls, but add that ‘^it is too small to be considered very sig- 
nificant.^^ 

(4) Dependence on school grade. Bonser found a general 
progress from grade to grade, coupled with a decrease of varia- 
bility; his results ar6 somewhat affected by the fact that his 
test was too easy for use much beyond the 6A grade. On the 
other hand, the curves of distribution published by Chambers 
show that it is impossible to distinguish 7th grade and 8th. 
grade impils by their curves of distribution in this test 

(5) Dependence on intelligence. With the exception of Win- 
teler’s conclusion (based on the study of only 8 boys, divided 
into two contrasted groups) that the opposites test is less well 
adapted than other forms of controlled association to reveal 
differences in intelligence, the general opinion of experimenters 
is decidedly favorable to its use for this purpose. Mrs. Squire 
found that pedagogically retarded pupils show a distinctly 
lower general average performance .with more irregularity in 
speed and quality of work than the unretarded. Bonser ob- 
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taiucd a correlation of 0.85 between opposites and the average 
standing in all the tests used by him to measure ability to rea- 
son, and declares that “the opposites test seems to be a test of 
rather superior merit as a single test for this general form of 
mental ability.” In Simpson’s interesting study of two con- 
trasted groups of adults (17 of superior, and 20 of quite in- 
ferior general ability) the two groups verc completely sepa- 
rated by both the easy and the hard oi)posites test, i. e., no 
person in the poorer group did as well as f'e poorest in the good 
group. Simpson estimates the true correlation with the intelli- 
gence of people in general to be as high as. 0.82 for the easy, 
and 0.9G for the hard opposites test. 

At. Bedford Hills Reformatory, Miss Weideiisull reports a 
correlation of 0.79, P.E. .03, between rank order in o])posites 
and the estimate of intelligence of the women made by the 
director of the Industrial School of the institution. The corre- 
lation would have been higher under more favorable conditions 
for the testing and the estimating. Again, the institutional 
women who had received the most schooling showed almost 
exactly the same ability as the Cincinnati 15-year-old working 
girls tested by Woolley and Fischer, whereas the Bedford Be- 
low-Grade GroujV (schooling less than Grade 51>) were de- 
cidedly inferior to the Bedford Grade .Group and to the Cin- 
einnati girls. 

(6) Ihc f €6l)l€’7}tiHd6d’ -dud dclhicjiiont , Iso fcGbl6*iiiiiid6d 
child, according to Miss Norsworthj’s figures, readied the 
median performance of normal children; only about one in a 
hundred were better than — 1 P.E. and only, about six in a hun- 
dred were better than —2 P.E. of normal children of their age. 

Reference has just been made to the comparison of delinquent 
women and school girls. Dr. Weidensalfs results show also 
that the Bedford women, taken as a group, are slightly inferior 
to the Cincinnati 15-year old working girls at the upjier quar- 
tile, 7.5 per cent, less accurate at the median and 20.2 per cent, 
less accurate at the lower quai*tiIo. It is of interest to note 
that the opposites test proved somewhat difficult of compre- 
hension for these so that special explanations had to be 
contrived and repeated as well before the testing could proceed. 
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(7) Dependence on practise. Hollingwortli (9) put 11 men 
and 8 women through 100 trials with opposites, and also tested 
their speed in reading the stimuli and the responses from a 
typewritten sheet. The results were: 

Initial luunhig (average of trials 2-6), men 113.5 sec., women 99.7 see 
Final naming (a vfTage of trials 96-l()0), “ 36.3 “ “ 31.2 “ 

Heading directly (average of 5 trials), “ 18.5 “ “ 16.1 “ 

It is seen that extensive ])ractise iuereases the speed of the 
associativii process markedly, but that even after 95 trials a 
considerable part of the time taken in the test is occupied by 
the process of association as over against the time needed in 
reading and uttering the words. The speed attained by indi- 
viduals ill tlie test by reading correlates with the si)eed ob- 
tained in the regular test of naming the opi>osites by approxi- 
mately O.GO. 

(8) Dependence on fatigue. In the course of his experi- 
ments upon the effects of caffein ITolIingwortli (8a) was able 
to observe the effects of time of day upon the opposites test 
under unusually favorable conditions as regards elimination 
of the practise error. In preliminary ex])eriments (tests made 
at intervals of two or three hours) and also in more intensive 
experiments (15 trials between 10.30 A. M. and 10.30 P. M.) 
there appeared a distinct reduction in speed of naming oppo- 
sites as the day paSsed, and the fatigue effect was more pro- 
nounced in this test than in any others that were tried. After 
the second trial the initial records of the day were never sur 
passed. 

(9) Dependence on race. In opposites, and also in other 
controlled association tests (genus-species, j)art-whole) , Pyle 
(13a) found negro children of both sexes less than half as 
efficient as white children, 

(10) ReUaJ)ilifn, Simpson found internal (orrelations 
between his various lists amounting to from 0.53 to 0.93 for 
his easy and to from 0.00 to 0.97 for his hard list. The test 
may, therefore, be regarded as possessing a good degree of re- 
liability, particularly since Bimpson’s lists contained some 
words of unequal difficulty and are presumably less well 
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adapted for testing than the lists which have here been pro- 
posed for standard use, 

(11) Various correlations. In the case of the women at Bed- 
ford Hills Reformatory, whose work was decidedly slow on the 
whole, the correlation between speed aiul accuracy was so high 
(0.83, P.E. .03, for those who needed no help in reading or 
writing) that the scoring was finally done in terms of accuracy 
alone. 

Correlations determined by Simpson between the easy and 
the hard opposites and other tests were as follows: with the 
Ebbirighans completion test 0.72 and 0.85, with memory for 
words 0.05 and 0.84, with the A-test 0.50 and 0.58, with memory 
for passages 0.50 and 0.70, with adding 0.50 and 0.70, respect- 
ively. These figures represent “estimated true correlations for 
{leople in general,’’ as based upon raw correlations figured for 
his own adult ^’s, corrected for attenuation and other probable 
sources of error.® 

Thorndike found a very high correlation, 0.90, P.E. about 
.05, between the capacities of twins in this test. 

Notes . — Special comparisons of different forms of controlled 
association have been made, among others, by Watt, Rusk and 
Winteler. The average association times reported by Watt are 
1.304 sec. for part-whole, 1.454 for whole-part, 1.418 for co-ordi- 
nate, 1.548 tor su|>erordinate and 1.859 for subordinate rela- 
tions. General agreement apjioars in the conclusions reached 
by Rusk, who lists the several varieties of association tested by 
him in the following order, passing from the easiest to the 
hardest: whole-part and part-whole, co-ordination, free con- 
cretes, sujierordination, subordination, free abstracts, causal, 
ll’inteler concludes that when superordinate, subordinate, co- 
ordinate, species-genus and opjiosite relations are tried with 
school children, the first takes the most and the last the least 
logical power. 

The so-called ^B-method’ of Ries, a test tn which is given a 
number of nouns representing causes and asked to name an- 


’8ee the orf^jliial article for the raw correlations and for correlations 
with other tests than those her’e cited. For Bonser’s correlations, which 
refer to various special tests, see hfs monograph, p. 9(1. 
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other noun representing a related effect, yielded M his hands 
extraordinarily high correlations with estimated intelligence, 
0.85, 0.8G, 0.91 and 0.94 in different groups. The method is 
endorsed by Meumann (11, I32f.), who also reports excellent 
results achieved with it by Oksala, in Finland. ^Meumann de- 
clares that the ea])acity to seek out causes or effects affords a 
decisive index of degi'ee of intelligence in children of from 
about 10 to 14 years, and perliai)S older. We have made attempts 
to use" this test in the educational laboratory, both at. Cornell 
University and at the University of Illinois, and have en- 
countered so many difficulties in the preparation of material, 
and especially in scoring, as to render the method unsatisfac- 
tory, even for mature college students. 

Another relatively easy, though strictly controlled associa- 
tion test is that known as ’the backward-alphabet test. This 
has usually been conducted by asking 8 to name, or to write, as 
rapidly as possible, the letters that precede f, Ic, 6*, p, tv, Z, r, 
d, 0 , Vj i, and h. For comparison, and to obtain a rough 
notion of ^’s I'amiliarity with the sequence of the alphabet in 
general, this test might l^c supplemented by anoUier in which <Sf 
was required to state the letters that follow another series of 
15 letters.® 
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TEST 34A 


Analogies.' — In Test 33 (he associations to be formed are left 
entirely to /8’s choice, are unrestricted; in Test 34 the associa- 
tion is restricted to a single form of relationship throughout 
any one series. In the analogies test there exists i-estriction, 
but the kind of restriction varies from one stimulus to another 


'The author is indebted to Professor D. Kennedy Fraser, of Cornell 
University, for the arrangement of this tesh 
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Avitlun the series of fcrms. Tlie kind of I'estrietion, moreover, 
is not iiulicniod U) H in (lie instnudions, but is sn])|)]ied to him 
by ni(‘ lest matei'ial i I self, and innst be apprehended by him 
from dial malerinl. l^hn-h stimiilns in the series (onsi.sls of 
tliree terms; Un* hist and second terms illustrate the relation 
in question; the third term is the tirstcof a pair which are to 
stand in tlie same relation one to another as the first and sec- 
ond terms. V'sqiroblem, then, is to tind the approjiriate fourth 
((‘rm. l>ecaiise the i elation varies from stimnlns to stimulus, 
the test is sometimes referred to as the bnixed relations test,’ 
as, for example, by Woodworth and W(dls (0), who say that it 
tests ‘tlexibility of mental jierformance’ and also ^skill in han- 
dlin'; assoeiations.’ Hurt (2), fiom whom the term dinafotyies' 
is borrowed, holds that the test involves ^^peree[)1ion, implicit 
or explicit, of the relation and reeonstrnction of the analogous 
one by so-call<‘d relative suggestion/’ The test is recommended 
by tlH‘se authors, as well as by Wyatt (7), and it needs little 
ti-ial to show that it has many ])Ossibilities, jiart icularly in 
view of the (hance that it affords of constructing series of 
stimuli of varying difficulty. 

]\rAThTjALs. — (1) For individual tests: Sfilit-secoiid stop- 
watch. Three sets of 20 cards each, affording tests of three 
grad(‘S of difheulty. Ram])le set of 7 cards for iireliminary 
trials. Prepared blank for registering times and incorrect an- 
swers. (2) For greiip tests or variant foian of individual tests: 
sto])-watch or special se('Ouds-clock. Printed forms for each of 
the three sets of stimuli, provided with si)aces for recording the 
responses. 

The st iimili chosen tor these series are taken from a large mnnher of 
stimuli originally cMujiloyed by DuVt in work with the analogies test in 
England- They have been select ed on the basis of fairly extensive trial 
with vi\ildren and high-svhool and college students. If further materials 
are d(‘sired, E will find it more protitable to turn to the two lists of 20 
stimuli each that are published by Woodwortli and Wells (als<i repro- 
ducetl by Briggs (1)) than to construct lists of his own, as only by actual 
trial can the feasibility of a given set of terms for use in this test bo 
demonstrated. 

Method. — ^^how one of the sample cards and instruct him 
as follows : “On each of these cards there are three words, as 
OK. this one. As wu see, there i.s relation between the first and 



TEST H4a r ANALOGIES 


[457] 01 


<lie second u’ord. Yon are also given a third word, and I want 
you to find a fourth word which shall have the same relation 
<o Hie third as thesf^ond has to the first. Work as rapidly as 
you can, and say the fourth word aloud as soon as you know 
what it should be. Thus, in this first card the fourth word 
is what? In the cards that follow the relation does not remain 
the same as this one, but varies from one card to another.’’ If 
this explanation seems sufficient, juoceed with the other sample 
cards, saying: ‘T will try these sample cards now to make 
sure that you ijnderstand.” 

Follow the instructions given in Test 34, part whole test, 
including the use of the warning 'now,’ the taking of limes 
during the sample set, the correction of wrong responses, etc., 
save that it is unnecessary to record iS’s response unless it be 
a word which is not provided for upon the pre{)ared form. In 
ordinary testing E should pass to the next card whenever ^ is 
unable to give a response within 30 see. Whether List A, List 
B, or List C, or some combination of them shall be used will 
depend upon *S^’s age and ability and upon the time at JEJ’s dis- 
posal. 

Variations of Method. — Follow the suggestions for variant 
methods given for the part-whole test. 

Treatment of Data. — This may be based, in general, upon 
the instructions already given for the part whole test and for 
the opposites test. 

The English investiga(x)rs have attempted a HOiiiewhat finer scoring 
of quality of response than we have recommended. Thus, Burt scored 
1 for each correct response, % for fair and % for poor responses, and 
0 for omissions. Wyatt gave 4, .3, 2, 1 or 0 for responses grading from 
fully correct to omissions,. This etaborate scoring is not needed for most 
of the terms in our lists, for in quite the majority of cases there is but 
one single correct resiwnse. In the other cases the use of the split-second 
watch in individual testing thermits E to wait until the covvect vespouso 
Isgiveu and secure a direct measure of the time needed for this response, 
while the time at which the first (erroneous) response is made can 
also be put on record as an Indirect measure of »S's -general accuracy. 


Results. — (1) A general idea of the. times that may be ex- 
pected by the use hf these three lists may l»e gained from the 
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results tluit have been obtained by their use in a limited num- 
ber of eases (Table 71). The averages exceed the medians on 
account of the occasional very long association (imes which 
appear with nearly all *S's. The average time reported for their 
lists by Woodworth and Wells (about a dozen college and 
graduate students, using the method of exposing the entire 
list) is 3.14 sec., P.E. .13, with a range for individual averages 
of from 2.33 to 4.40 sec. 


TABLE 71 

l^pecd in »STo. far Correct Responses in the Annioffics Test {Fraser) 




LIST 

A* 

LIST 

b’’ I 

LIST C 

Croup 



Cates 

Median | 

Aver. 

Median 1 

1 

Aver. 

Median 

Aver. 

College 

8 

i 

1.8 ! 

2.36 

3.0 

4.38 

3.4 

6.51 

Adi>!ts 

19 

2.0 ; 

2.64 





High-school 
Girls 

30 

2.1 

3.IG 

- 

— 

1 

— 


'Lists A anti B, at the time these li^^iires were st^euretl, eoiitaiued 25 
stimuli each. The omitted ones do not alter the conditions enough, how- 
ever, to invalidate these records as norms. 


More extended use of the Woodworth and Wells tests by 
W. V. Bingham, to whom I am indebted for advance figures 
from the results secured with 2i)0 freshmen at Dartmoutli Col- 
lege, has yielded the following jiercentile distribution for the 
analogies test (average time in seck ])er respoiivse, based on two 
trials of 10 I’esponses each) : 


Poorest 

5.49 


10 20 30 40 50 60 70 80 IK) Best 

3.98 3.69 3.31 3.03 2.85 2.67 2.52 2.36 2.06 1.35 


(2) Dependence on age. While sufficient data are lacking 
to present figures for various ages, there is a clear difference in 
the sliced of of grammar-scliool, high-school and college 
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Ntaiiding when List A is used Similarly, List B, and more espe* 
(ially List C, proves too diflSeult for younger *S’s. 

(f5) Dependence on srx. Burt found an advantage of 15 per 
cent, ill favor of the girls at the Wallasley School, Liverpool, 
i. €., only per cent, of the boys reached the median perform- 
ance of girls. In other tests at the Holt Secondary School, 
however, the average performances of the two sexes were vir- 
tually identical. No sex difference appeared in our tests of 
Cornell University students. 

(4) Dependence on intelligence. Wyatt, working with the 
time limit method on groups, found that the analogies test 
afforded the highest correlations with intelligence of any of 
the tests he tried, save the completion test. His correlations 
amount to 0.62 in one and 0.80 in another group. Burt^s tests 
at the Holt School gave a correlation between the results of 
analogies and intelligence of 0.50 in the individual test and 0.52 
in the group test; his tests at the Wallasey School gave again 
a correlation of 0.50 (see Burt and Moore). 

(5) Reliahility, BurCs figures show that the analogies test 
possesses a good degree of reliability, as its coefficient of inter- 
nal correlation figured in different trials 0.58, 0.71 and 0.92. 

Notks. — The analogies test appears to be better suited than 
other tests of association to bring out individual differences in 
tjuickness of adaptation to the task demanded. Thus, in the 
case of one high school girl, the average association time for 
the first half of the list was 4.83 sec., for the second half only 
2.19 sec. The inference that this 8 was naturally slow in adapt- 
ing herself to new situations, but was able to work efficiently 
when once adaf)(ed, was afterward confirmed by the reports 
secured from her teachers of her performance in her school 
tasks, especially in geometry. 

When ^S\s are tested by the standard method of seevrring the 
time for each response, it is often instructive to plot a rough 
frequency curve, with the second as a unit. A comparison of 
the distribution of the times for different 8'^, as in the following 
samjde, shows eiearly individual differences in steadiness and 
consistency of performance as well as differences in general 
tendency toward fast or slow rates of mental activity. 
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Dihtyihuiiou for Tu:o College StudaiiSj List V 


SECONDS 

1 

2 

3 

- 

5 

G 

7 

8 

y 

104- 

MKD1\N 

1 — 

AVER, 

Subject 

1 1 

1 9 ! 

3 i 

4 

0 

1 

i 1 

1 0 

! 0 

1 

2.9 i 

3.91 

Subject G — ^ 

' ^ 1 

i 4 

3 i 

1 

j3 

2 

1 

! 2 

j 

1 

1 

3 

i 5.6 

5.67 


It is also instructive to make notes of general attitude to* 
ward the test, whether confident or hesitating, hurried or tnin* 
quil, etc., and to compare these attitudes with the quantitative 
results. 
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. TEST 35 

Controlled association: Computation. — The solution of simple 
arithmetical problems in addition, subtraction, multiplication, 
and division may be considered as essentially dependent upon 
the accuracy and rapidity with which the appropriate associ- 
ative processes are executed. Computation is, therefore, a 
test of controlled association in which the restriction of the 
associative sequence is complete, in which only a single out- 
come is correct. But numerous subsidiary activities are, of 
course, involved. Thus, the solution of arithmetical problems 
with the aid of paper and pencil demands, beside associative 
activity, both visual perception and motor activity, while men- 
tal computation imposes an additional tax by necessitating the 
holding in mind of the problem itself and of the various steps 
in its solution. 
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Because of this implication of perception, movement, atten- 
tion, retention, and perhaps other forms of mental activity^ 
as well as simple associative activity, the computation test has 
been employed not merely for the special purpose of studying 
the nature and course of associative processes, but also for the 
more general purpose of investigating mental efficiency at large 
(geistige L^stungsfdhigkeit). Oehrn, ft r example, who was 
one of the first to use computation as a mental test, sought to 
study individual differences in the nature of associative proc- 
esses ; Aikins, Thorndike, and Hubbell, Brown, Burt, Simpson, 
Hollingworth, and Krueger and Spearman to study the correla- 
tion of specific mental functions J Thorndike to determine the 
relative influence of heredity atid environment upon mental 
efficiency ; Reis to compare the ability of normal, paralytic, and 
hebephrenic children; Jones to inveptigate the effect of bodily 
posture, Vogt the effect of distraction, and Hollingworth the 
effect of caffein upon mental efficiency; Winch and Starch to 
investigate the transfer of special drill. But the commonest 
application of the computation test has been made in the for- 
mulation of the curve of . mental efficiency, or the work-curve 
{Arhcitskurve) , with special reference to the influence of prac- 
tise, rest-pauses, exercise, and similar factors upon the mental 
efficiency of adults, and especially of children, during a school 
day. This use of the test is illustrated in the work of Arai, 
Bellei, Bischoff, Bolton, Burgerstein, . EblJinghaus Friedrich, 
Heck, Heuman, Holmes, Katzen-Ellenbogen, Kafemann, Keller, 
Kemsies, Laser, Bindley, Marsh, Martin,. Ordahl, Robinson. 
Schultze, Specht, Teljatnik, Thorndike, Wells, Weygandt, 
Winch and others.^ 

Addition, multiplication, and both in alternation, have been 
more popular forms of computation than subtraction or divi- 
sion. With hll four forms varied types of problems have been 
used. These variations in the arrangement of the test natu- 
rally affect its outcome. The most important types of test are 
illustrated herewith. Beside the types that are shown, Winch 

major portion of these studies are the direct or Indirect develop- 
ments of the special technique of the adding experiment as formulate 
by Kraepelin and his followers (see the various volumes of the Psp- 
chologische Arheiten and Kraepelin’s summary (27). 
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and others have employed miscellaneoiLS arithmetical problems,- 
Reis had his add mentally for 1 min. by 7^s or by 12’s, while 
Hollingworth has used a form of test, also recommended by 
Woodworth and ^YelIs, in which a constant number is added 
(or subtracted) from a given list of numbers. 


Examples of Material Used hi Computation Tests 


A 

B 

C 4 2 8 3 

2 9 9 5 4 0 5 4 3 1 7 

E 42 F 492 

2 

4 

7 9 2 9 

3 8 3 8 2 0 5 5 1 3 9 

-j- <9 4“ ^b3 

() 

1 

1 1 b 2" 

etc. ^ ~ ^ ' 

■ 

9 

3 




7 

5 

D G 

H 042030-131 9483 1457(>2T 

1 982 J K 2$ 

4 

2 

95799 93 

4-38082725423585791858 - 

-409 —27 X 8 

8 

(> 

80997 08 



9 

4 

32087 41 

L M -J" N 04S 

0 7086 R 4)799 

r» 

3 

84799 25 

x« XS» X 570 


1 

4 

95970 52 



7 

C 

34707 



0 

1 

97804 

P 42S423995470253314325 

Q 254) 4650234 ( 

2 

5 

08945 

X± 



0 

4 

87821 



9 

2 

0S792 



5 

1 

79807 



1 

2 

88890 




3 

97745 



9 

0 

39799 



*» 

5 

48970 



1 

3 

89043 



3 

G 

07354 



<> 

5 

54028 , 



9 

1 

91170 



8 

2 

90253 




a 

G 

2 

7 

6 

2 


=It is hardly necessary to allude to the development and use, particu- 
larly by C('urtis, ol‘ special sets of tests for nieasurinj;. the abilities of 
school children in the fundamental oi)erations of arithmetic, the solving 
of arithmetical problems, copying ligures and the like. Similar tests 
for algebra and geometry have been announced recently by other investi- 
gators. Tests of this variety are, of course, alined at the determination 
of specific pedagogical attainments and differ, therefore, in scope and 
method from those here under consideration. For an account of the 
Courtis tests, with results of their application to a large group of 
school children, see Courtis (12). 
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EXPLANA ’ ORY 

/Uhffiinn 

A. Vortical sorios of l-place nnuibcrs, arranged to avoid repetitions 
and }>airs adding to 10. N’s add continuously and drop back to units 
wJ«c‘n each lunidrod is reached, or add by jaurs, either orally or writing 
down iJio unit hgure of each sum. The pairs are sometimes taken so 
that each digit is used twice, thus N adds 1 and 2, 2 and 3, 3 and 4, etc., 
and soniotinu'S so that each digit is used once, as 1 and 2, 3 and 4, etc. 
Ocdn-n, Yogi, and otliers working under Kraei>elin used columns of as 
many as 7,000 of such digits. Krueger and Spearman used 70, grouped 
by liVs as illustrated. Marsh used similar t*oIiiinns of 15 or 25 digits. 

1C Vertical column of 24 1-pIace niimhers, using 1 to G only. Used 
l>y Jones, who had add aloud while he himseif followed with a (‘heck 
list, 

C. Horizontal series of I place pairs of digits. A modification of the 
Kiacpclin l-place series in order to* make possible the examination of 
the accuracy of each addition. The unit figure of the sum is the only one 
i(‘corded, as illustrated in tlie first four problems. Used by Schulze, and 
;»pparenlly also by Ebbingliaiis and by Vogt. 

1>. Twenty 5-place lunnbers. Useci by Tborndike. 

10. Two 2-place numbers. Used by Teljatnik. 

1\ Two 3-place numbers. Used by Kemsies for nu‘ntal addition. 

(1. Five 2-place numbers. Twenty such problems wore given and 2 
min. allowed for computation. Used by Tborndike and by Aikins, Thorn- 
dike and Ilnbbell. Four longer columns (25 numbers in each) are used 
in the Woodworth and Wells constant-increment test. 

11. Two 20-place niimhers. Used by Burgerstcin, Laser, Friedrich, 
and Holmes. The last-named investigator jniblished elaborate rules for 
the construction of these problems in such a way as to avoid the exten- 
sion of errors in ‘carrying.’ . She used 4 blanks with 10 Jiuch problems 
on each blank. 

^Uihtractiou 

I. Two 3-place numbers. Used by Kemsies for mental subtraction. 

J. Two 2-place ninnbers, to be written on the l^lackboard (Teljatnik). 

MtiUlpJicatlon 

K. Two-place multiplicand, l-place multiplier. Used by Kemsies for 
mental computation, and by Ebbingbaus for written group tests. 

L. Tliree-])lace iniiltiiilicand, l-jdace multiplier. Used by Kemsies. 

]Sr. Two-j)lace miiltiiilicand, 2-place multiplier. Used by K(‘ller, and 
by Marsh Avlfli the digits 1, 2, 5, and t> excluded. 

N. Tbrcc-]»lace multiplicand, 3-place multiplier. Used by Keller for 
written, and by Thorndike for mental computation. 

O. Fonr-])lace ninltiplicand and multiplier. Used by Thorndike and 
ethers bolli for written and for mental computation. The multiplicand 
is usually a combination of tJ, 7, 8, and 0; the mulllplier of 2, 3, 4, and 5. 

1*. Twenty-place muUipli<and, l-place mulliplier. Used by Burger- 
stein, Lasew, and Friedrich, with the restriction of the multiplier, in 
most tests, to 2, 3, 4, 5, or G. 

Division 

Q. Three-place divisor, 7'place dividend. Four blanks of 10 problems 
each were used by Bellei for an hour’s work. 

R. One-place divisor, dividend. Used by Kemsies for mental 

computation. 
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There ai*e certain advantages and certain disadvantages in 
each of these forms of material. In general, E must select that 
form of test that best suits the conditions under which he 
works. 

Materials. — 8top* watch, preferably split secoud. Printed 
forms, containing problems in addition and multiplication. 
For group tests, the special seconds clock. 

B"ive forms Lave been prepared for ibis test: others may be prepared 
by E as desired. 

A. Addition test : several thousand digits in vertical columns with a 
line separating each 10 digits, after Model A. This form may be used 
with children or with adults, and either for short series or for continu- 
ous adding, after the Kraepeliu method, after the plan of Krueger and 
Spearman, or after the method of adding pairs. 

B. Addition test with 36 problems, patterned after Model G, but con- 
taining 10, In place of 5 numbers each. This can be used also for tests 
in which a constant number Is added or subtracted. 

C. Addition test, patterned after Model C (Schulze’s method), and 
specially recommended for younger ;S’s. 

D. Addition test, patterned after Holmes, Model H, and virtually 
Identical with the material used by Burgersteiu, Laser, and Friedrich. 

E. Multiplication test, after Model P, as used by Burgerstein, Laser, 
and Friedrich. 

Method. — (1) General determination of S^s ability may be 
carried on with any One of the forms. The following general 
principles should be kept in mind: (a) Individual tests are 
usually more satisfactory than group tests, (h) Any computa-v 
(ion work that is so easy that the mental operations can pro- 
ceed as fast as thO results can be written (as Form C for 
adults) would better be given individually and arranged so 
that is may announce the results orally and E check them off 
upon a preiiared key; and in general, care must be taken that 
(he recording of results shall not fall to unless it is certain 
that his associations will neither be delayed nor disturbed by 
the process of recording, (c) Group tests with competent 8’s 
may be most satisfactorily carried on by the work-limit method 
with the aid of the seconds clock, (d) Group tests by the time- 
limit method should, as a rule, be terminated at such a lime 
that the fastest S in the group can no more than complete the 
task. 

, In accordance with these general t>rinciples, Forms B, D and 
F will be found adapted for group tests or for individual tests 
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with the recording of the liguriug done /V himself. E can 
take the time for performing any specified nimiber of the proh 
iems, or he may also, especially by using a split-second stop 
watch, secure the exact time for solving eaeh problem without 
interrupting work until the entire test form is finished. 

For the constant-increment test S is given Form B, printed 
side down. He is instructed at the signal bmw' to add a speci- 
fied number to each number’ found in the columns when he turns 
over the form. The numbers commonly used have been either 
4 or 17. The test may be repeated with other increments, and 
these may be so chosen as to secure wide variations in difti 
culty, as by assigning easy constants, like 1 or 2, or more 
difficult ones than 17. xVgain, the assignment may l)e to sub- 
tract a given number.- 

Form C aflCords a particularly good test of skill and accu 
racy in the addition of units, especially when conducted orally. 
Record the time for each row horizontally. Adults will make 
but few errors, and these they may be allowed to pass over or 
to correct, whichever w^ay they may prefer. 

Form A may be given by a variety of methods. In particular, 
iS’ may write down the sums for each section of 10 digits and E 
record the time for each section until one page of the material 
has been covered : or S may add orally by pairs while E w’atches 
for errors upon a prepared check sheet, and also notes upon it 
the place reached by at given time-intenvals, as at each 
minute or each half-minute; the adding in this case may be 
done by either of the methods of grouping the [>airs mentioned 
above (Explanatory, Addition, A). 

(2) For those who wish to arrange an experiment for the 
special determination of S^s susceptibility to practise, fatigue, 
etc,, some suggestions may be found in the following develop- 
ment of the method of Kraepelin illustrated in the work of 
Specht and of Bischotf. To carry out this experiment fully, 
adds by pairs, 10 min. per day, on each of 12 successive days.* 

*For timing work by columns a convenient arrangement is to cut them 
out of the form and paste them singly upon small stiff cards. 

•It would seem possible to condense this tlnte, either by taking fewer 
days or by adding during several sittings on a given day, though it Is 
impossible to predict whether the results would then be comparable to 
those reported below from Specht and Blschoff. 
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Tlic pairs are added by llie 1 aiid 2, 2 and 3 method and the unit 
figure only of each sum is written down by S,* A bell-stroke 
or other signal is given at the end of each minute, and aS^ marks 
by a horizontal stroke the point he lias reached at the signal. 
On the 1st, 3d, 5th, Tlh, Otlr and 11th days there is introduced 
between the 5th and the Gth minute of the adding a rest-pause 
of 5 min.: on even-numbered days aV adds directly through the 
10 min. without pause. 

In carrying out tliis special form of addition test, or in fact, in carry- 
ing out any test which Is designed to. measure efficiency under various 
conditions — different periods of the day, after recesses, after gymnastics, 
after eating, etc. — it is evident that E must bear in mind the possibility 
that a nninher of different factors may enter to affect the performance, 
and that to measure iiny single factor, like fatigue, the influence of these 
other factors must be exc luded or allowed for. The most serious of these 
disturbing factors are iwaclise, excitement, ennui and carelessness, 

A common method for cancelling out practise is to divide »S’s into two 
equivalent groups on the !»asis of a preliminary test, and to administer 
one set of problems early to the first, and late to the second group (if. 
for instance, fatigue is to he investigated), the other set late to the first, 
and early to the second group. 

In studying the work curve, some have used computation both as 
the test and as the work to induce fatigue, practise, etc.; others have 
used computation as a test of efficiency, but have allowed S to follow in 
the main the regular work of the school session. In the first procedure, 
computation (usually addition) is pursued more or less continuously 
for an hour, or even for several hours; in the sec*ond procedure, the com- 
putation itself occupies hut a short time, relatively, say from 1 to 10 
min., and is repeated at intervals of an hour or more, while meantime 
takes up his regular tasks, indulges in physical activity, or rests, as E 
may direct, • 

In illustration, Vogt, Oehrn, and other disciples of Kraepelin, have 
kept their ^”s adding continnoiisly for several hours; Holmes used 4 
periods of adding of 0 min, each, with 4-min. rest-pauses, Burgerstein 4 
periods of 10 min, each, with .5-inin. pauses. Typical illustrations of the 
second procedure are supplied by the investigations of Laser and of 
Ebbinghaus, who introduced 10-min. computation tests at the beginning 
of the school day and once an hour thereafter, and also by the studies of 
Heck and of Bobinsoii. Ebbinghaus is inclined, however, to rec-ommend 
5-min. tests as l>eing equally servicer.’ for tlie determination of effi- 
ciency and less likely to develop ennui and Carelessness. Offner (35, 
p. 48) favors short tests for similar reasons and also for the partial 
avoidance of the practise-error. 


Treat:ment of Bata. — Compittation test.s yield two measures 
of efficiency — speed (or quantity of work) and accuracy (or 


*It would seem to the author much preferable to use oral adding, but 
here, again, it is not possible to predict what effect such an alteration 
of method might have upon the results. 
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quality of work). Many investigators, particularly when exam- 
ining the efifect of practise, fatigue and similar factors upon per- 
formance, have found it best to keep the two measures sepa 
rate. Some investigators, like Teljatnik, have considered qual 
ity of work only; more often, qualitative differences, being 
relatively small, have been disregarded and performance has 
been ranked by speed of work only The c^^mb-ining of speed 
and accuracy into a single score repi*e8enting net efficiency may 
be attempted by some of the methods proposed in Test 2(). Or, 
an arbitrary |)enalty may be contrived for each error and the 
time consumed may be increased by these penalties. Thus, 
Simpson, who used material like our Example G, computed 
the final score of his S^s by adding to their actual time 10 sec. 
for each error. An who added 10 examples in 55 sec. and got 
seven answers right and three wrong would then be given a 
final score of 85 sec. 

Quantity of work is indicated l>y elapsed time when using the 
individual method, and by the number of problems solved 
(sometimes by the number of figures written in the results) in 
the time-limit method. 

Quality of work is generally regarded as directly propor- 
tional to the percentage of correct solutions. Inaccuracy is 
most often taken in terms of the number of errors committed, 
less often in terms of the number of erroi*s jdus the number 
ot corrections made by S. The simplest, but tife least desirable 
way to compute errors is to score one error for every wrong 
figure in the result. In the case of certain problems, however, 
a single error in computation may affect more than one figure 
in the result.^ For reliable results, these complex errors must 
be examined and the score adjusted to indicate exactly the num 
ber of real erroi*s of computation. 

For the special experiment patterned after Specht and 
Bischoff more elaborate treatment of data is called for. (1) 
The gain in sums added the 6th min. as compared with the 5th 
min., in its relation to the sums added the 5th min. (i. e., the 
per cent of gain) is computed both for all the days with pause 

*The problems in Form D (Example II) nro Intentionnlly arranged to 
reduce this error. 
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and for all the days without pause, and the dilTereiioe between 
these two relative gains is found. (2) The number of sQins 
added in the first five and in the second live minutes, both on 
days with and on days without i>ause, is treated in the same 
manner. (,‘5) The difference between the sums added on the 2d 
and file OUi minute on days with pause, taken as a p<n* cent, of 
gain over the 2d minute, forms the coefficient of practise. (4) 
To find the coefficient of fatigue 
let F ~ the required coefficient Of fatigue, 

P — the coefficient of practise, 

A = the sums added the first 5 min. without pause, 

B the suius added the second 5 min. without pause, and 

b the sums theoretically added the second 5 min. under 

])ractise, but not under fatigue. 

AX (100 + P) 100 X (h — B) 

Then b — and F 

100 h 

Thus, if P — 8.8, A — 1226, B ~ 1141, then b 1333.9 and 
F ~ 14.46. (5) The difference between the sums added in the 

2d min, and in the 10th min. of days without pause, taken as a 
ratio to the 2d min., affords another, and in some respects, a 
better index of fatigue. (6) The total number of sums added 
the 1st 5 min. of all days gives T (total performance), which 
affords an approximate notion of aS's ability to add. T is also 
made the denominator of a fraction, the numerator of which is 
the total number of additions made the very first 5 min. The 
fraction gives some indication of /S’s susceptibility to prac- 
tise. (7) Another index of susceptibility to practise is se- 
cured by taking the average of the gains in the first 5 min. 
from day to day as against the first day and figuring the dif- 
ference as a ratio to the first 5 min. (1st day). Characteristic 
results for all these values are given, below. 

Results. — (1 ) Woodworth and Wells report the average time 
of college students in the Kraepelin form of addipg as 107.2 
sec., range 65 to 164 sec. The same authors report for the con- 
stant increment test (one column of 25 numbers) adding 4: 
average 33.9, range 24 to 49 sec.; subtracting 4, average 41.1, 
range 25 to 67 sec.; adding 17, average 97.4, range 62 1o 158 
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sec.j with an average of 2.4 errors in the last form of test. 
These figures are based upon a very limited number of iS’s 
(7 to 10). In the author’s laboratory, tests with college stu- 
dents in adding 50 sections of 10 digits on the Kraepelin form 
have yielded individual averages per section of from 5.8 to 
13.7 sec., while the number of correct sections has ranged from 
34 to 46. 

(2) In all computation tests, and particularly in those em- 
bodying mental multiplication, there a;e marked individual 
differences in speed and accuracy, even among /8’s of the same 
age and same school grade. Thus, Schulze's best }»upil added 
more than 5 times as fast as the slowest pupil in the same 
class. 

(3) Dependence on sex. There is evidently no decided sex 
difference in computation, since the results of various investi- 
gators are conflicting. Burt found girls slightly slower in 
multiplication ; Burt and Moore reckon that 65 per cent, of boys 
exceed the 50 per cent, record of girls in adding and 63 per cent, 
exceed the 50 per cent, record of girls in nniltiplication. On 
the other hand, Courtis’ New York results show that girls are 
slightly better than boys in the fundamental operations of 
arithmetic. Again, Miss Holmes found girls slightly belter 
than boys, and the conclusion of Fox and Thorndike is that the 
girls in the high school they studied were about 5 per cent, 
better than boys, though here there may have been a better 
grade of girls selected by the school. In the solving of arith 
metical problems, however, where something more than knowl- 
edge of the fundamental operations is involved, the w'ork of 
Courtis and of Thorndike (52) shows a superiority of boys 
amounting to an excess of some 10 per cent, in the distribution, 
above the median of I he girls. ‘Ttoughly, boys are about half 
as far ahead of the girls in the same grade as they are of the 
boys in the preceding grade,” Heck found that boys fell off 
more in quality of w^ork in the afternoon session than did girls 
(4.25 vs. 1.96 per cent.) — a result possibly due to a greater 
carelessness on the part of the boys. 

(4) Dependence on school grade. When sufficiently large 
groups are compared, there is, of course, a j^erceptible differ 
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once between the performance of one grade and that of (he 
grades above or below it, but this difference is small in com- 
parison with the 3-ange of variation within any grade, and 
may, on that account, disaj)pear wlieu small gi*onj)s are com- 
pared. Thus, the curves of distribution in adding reported 
by Chambers for 22 seventh and 22 eighth grade pupils can 
not be distinguished, wliile Courtis gencralizt^s results for his 
multiplication test by saying that ‘‘35 jxm- cent, of any grade 
membership will exceed the average score of the next higher 
grade: also, that 35 per cent, of the grade membership will fijill 
below the average of the next lower giade-’ (12, p. 450) 

(5) Dependence on practise. All investigators agree that 
practise produces a considerable improvement in all forms of 
computation, despite the fact that the associative connections 
concerned have been long established and often us(»d. Holling 
worth, who used the constant-increment test (adding 17 to 50 
2-place numbers) found that, even after 35 preliminary trials, 
one of his groups reduced their average time from 102.7 to G1.2 
sec. during 17 further trials, a reduction of some 40 i)er cent. 
Similarly, the 19 university students imported by Thorndike, 
who added daily for a week 48 columns of ten numbers, effected 
a median reduction in time of about 31 per cent., and in accu- 
racy of about 29 per cent., although the total amount of time 
spent in the work was only about one hour for each N. Not 
all these S^s showed* such practise effects; for one or two there 
was no improvement, while one improved as much as 50 j>er 
cent. It is worth noting that practise-improvement is shown 
by those who stand high at the beginning of the Avork as well 
as by those who stand low then. The same result has been 
found also in tests of 29 boys in a Ncav York City 4th grade 
school, where, according to Donovan and Thorndike, those inost 
efficient at the beginning gained on the average as much or 
more (in gross gains) as did those least efficient at the Ik'- 
ginning. Wells’ tests of adults (5G) lead to a similar con- 
clusion. On the whole, however, practise in adding tends to 
reduce somewhat the initial differences between the whereas 
practise in mental multiplication seems not to affect much the 
relative differences betAA^een 8% from Avhich Thorndike con- 
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eludes that the abilities demanded in mental multiplication 
arc more dependent upon original capacity than are those de- 
manded in adding. Mrs. Ordahl found that practise in mental 
multiplication produced a decided gain, in speed without much 
improvement in accuracy, and she believes that the improve- 
ment in this operation resides more in the methods of handling 
the task than in the facilitation of the numerical assoeiatious 
themselves.® 

The question of the transfer of practise-etfects in computa- 
tion to other forms of mental activity has been studied by 
Winch and by Starch. Winch was unable to decide whether 
special drill in computation produced an increase of skill in 
solving arithmetical problems; there appeared to be a transfer 
in some of the classes, but not in others. Starch found that a 
14-day drill in mental .multiplication developed an improve- 
ment of from 20 to 40 per cent, in other arithmetical operations, 
but had little effect upon auditory memory span. 

(6) Dependence on intelligence. Burt tested English school 
children, aged 12, to determine the number of additions or mul- 
tiplications correctly made in 10 min., and found a correlation 
with intelligence of 0.25 in addition and of 0.41 in multiplica- 
tion. Brown'S results for a group of 39 girls, aged 11 to 12, 
show no correlation between school grades and speed or accu- 
racy of adding and a correlation of only 0.10 between speed 
of adding and estimated general intelligence: his results for an- 
other group of 40 boys of the same age show correlations of 
0.28 between speed of adding and school marks, of 0.24 between 
speed of adding and estimated intelligence, and of 0.11 be- 
tween accuracy of adding and marks, with absence of correlation . 
between accuracy and estimated intelligence. Simpson used 
adding in his study of two sharply-contrasted groups of adults; 
the test separated the groups fairly clearly — only TO per cent, 
of the poor group reached the median performance of the good 
group. Within the good group the results of the adding test 
correlated by 0,72 with estimated intelligence. 

(7) Reliahilitg. Save for Burfs figures (0.50 for adding 
and 0.55 for multiplication), the internal correlations for com^ 

^Consult her article for detailed tables and introspective report 
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putation tests show a good degree of reliability. KTueger aitd 
Spearman, for instance, obtained a reliability of 0.76, Simpson 
of 0.76 for his good group, 0.90 for bis poor group, 0.91 for 
both together. Brown, who worked with several different 
groups, reckons the reliability for speed of adding at 0.68 to 
0.08 and for accuracy of adding at 0.30 when one application 
of the test is made, and reliability for speed at 0.81 to 0.99 and 
for accuracy at 0,36 to 0.74 when the scores represent amalga- 
mated results of two applications. 

(8) Correlations. Aikins, Thorndike, and Hubbell compared 
eflSciency in adding with efficiency in the other ^association^ 
tests (misspelled words, cancellation of two letters, and op- 
posites), and (by a special method of estimating the index) 
found the quality of work in adding and quantity of work in 
associating correlated to a degree of 50 per cent, in Sth-grade, 
and 20 per cent, in 5th-grade pupils, and net efficiency in adding 
and net efficiency in associating correlated to a degree of 48 per 
cent. On the other hand, the percentage of error in adding and 
in the other association tests exhibited no correlation or one 
of but slight degree. 

Thorndike’s study of mental resemblances in twins (47) 
showed a much higher correlation of ability in computation 
between twins than between siblings; thus, twins aged 9-11 
years revealed a ^correlation of 0.90 in adding, and 0.91 in mul- 
tiplication, and twins aged 12-14 years a correlation of 0.54 in 
adding and 0.69 in multiplication : taken collectively, the index 
of correlation amounted to 0.75 for the adding, and 0.84 for 
the multiplication test. 

Fox and Thorndike found that ability to add correlated to a 
fairly high degree, 0.75, with ability to multiply, but only to a 
small degree, 0.20 to 0,44, with ability to solve fractions or to 
perform other arithmetical x^^'^blems. They conclude that 
‘lability in arithmetic is thus but an abstract name for a num- 
ber of partially independent abilities.’’ 

These results do not agree well with those reached by Winch 
in his two studies of the transfer of drill in numerical accu- 
racy, since he fi>und high correlations (0.68, 0.69 and 0.74) be- 
rween accuracy in computation and in arithmetical reasoning. 
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Burris found that, school grades in algebra and in geonietry, 
as recorded in 19 representative high schools, showed, for 
nearly 1000 pupils, a correlation of 0.45. 

Simpson publishes the following ^^estimated true correla- 
tions for people in general” with efficiency in adding: Ebbing- 
Jiaus completion test 0.65, hard opposites 0.70, easy opposites 
0.5G, a test 0.58, memory for passages 0.42, estimation of lengths 
0.00. The extended series of intercorrelations found by Brown, 
which are in general much lower than those of Siinpson, will 
be found reproduced in Simpson (41, 107f.) as well as in the 
original text (5, 309-313, 316). 

Krueger and Spearman found a good degree of correlation 
between adding and pitch discrimination (raw correlation 
0.67, ^corrected’ correlation 0.68, ^completed’ correlation 0.80) 
and between adding and the Ebbinghaus test (raw correlation 
0.79, 'corrected’ correlation 0.68, 'completed’ correlation 0.93). 

Hollingworth (20) has studied the elfeet of a long series of 
trials (over 200) upon the correlations between adding and 
.various tests; the following are typical results: 



TAPPING 

1 CO- i 

ORDINATION 

DISCRIM. 

REACTION 

COLOR 

NAMING 

OPPOSITES 

1st trial 

.45 

I 

.21 

.23 

.26 

.23 ' 

20ath trial- 

.57 

.16 

.15 

.76 

.76 


(9) Relation of speed and accuracy. While it is doubtless 
true that, for a given individual working under constant condi- 
tions, an increase of speed fends to x>roduce an increase of 
errors, it is equally true that under actual working conditions 
a given individual may show an increase of speed coupled 
with a decrease in number of errors. When individuals are 
compared, it is found that the faster /?’s are, on the whole, also 
the more accurate fif’s. In six of his groups Brown found cor- 
relations between speed and accuracy of adding ranging from 
0;13 to 0.43, P.E.’s from .07 to .12. With small groups of col- 
lege students I have obtained similar positive correlations of 
0.19 in the case of adding and as high as 0.86 for mental multi- 
plication. 
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(10) Mental defectives. Eeis found that with paralytics and 
hebephrenics the average performance was less and the varia- 
bility greater than with normals. Similarly, Specht says that, 
though there appear decided individual differences in fatigra- 
bleness as shown by the adding lest applied to normal indi- 
viduals, a stil] greater amount of fatiguableness appears when it 
is applied to patients in an insane hospital selected for their 
tendency tovyard easy fatiguableness in general. I have combined 
the data furnished by Bischoff* for 12 normal S’s and by Specht 
for 17 normal and 6 insane when tested by their special 
form of the Kraepelin addition test and scored according to the 
directions given above for that experiment. The results are 
given in Table 72. The differences between the two groups are 
readily obvious in Factors 8 and 0, which reveal tendency to- 
ward fatigue, and in Factors 10 and 11, which show the total 
amount of work done. Analogous results have been reported 
by Katzen-Ellenbogen, who concludes that ^^the average curve 
of epileptics is decidedly different from the normal [curve] 
and characteristic of epilepsy.’^ 

TABLE 72 

Average Scores of 20 l^ormal and 6 Insane Subjects in the Addition Test 
, {After Specht and Bischoff), 

Normals. Patients. 


(1) Per cent gain 6th over 5tli min., with pause. . 14.7 20.G 

(2) Per cent gain 6th over 5th min., no pause — 1.0 — 3.9 

(3) Difference between (1) and (2) 15.7 24.5 

(4) Per cent, gain 2d over 1st 5 min., with pause. . 4.4 — 0.3 

(5) Per cent, gain 2d over 1st 5 min., no pause. . . . — 5.0 — 11.4 

(6) Difference between (4) and (5) 9.9 11.1 

(7) Coefficient of practise. 9.9 13.3 

(8) Coefficient of fatigue — 12.6 — 21.3 

(9) Per cent, gain lOth over 2d min., no pause — 5.6 — 14.3 

(10) Additions 1st 5 min. in 1st trial 172.3 87.5 

(11) Total additions 1st 5 min. of all trials 3406.8 1157.6 

(12) Progress of practise 11.1 2.0 


(11) Miscellaneous influences. Hollingworth (19) used add- 
ing among other tests in his study of the effects of caffeui and 
found that this drug produces pronounced stimulation in the 
processes of adding. 

Posture was found by Jones to affect the speed of adding; 
both children and college students could add somewhat faster 
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(approximately 3 to 8 per cent.) with the body in a horizontal, 
than with the body in a vertical* position. 

The effect of distraction ly corcoinitant activities, c, g,y the 
reciting of a poem, was found by Vogt to reduce very mate- 
rially (58.5 per cent.) the number of additions made by the 
continuous (Kraepelin) method, but to have relatively little 
effect upon the simpler process of adding pairs of digits. 

(12) Fatigue and other factors of the icorlc curve. The use 
of computation tests to determine general mental efficiency at 
different hours of the day, with special reference to the per- 
formance of school children under classroom conditions, rep- 
resents a special form of experiment that oversteps the bound- 
aries of mental tests in their diagnostic use. In what follows, 
therefore, I have limited the treatment to presenting typical 
results and to pointing out certain important general prin* 
ciples that have been established in this field.^ 

{a) General analysis of the work curve. In other tests (espe- 
cially Nos. iO and 2G) we have had occasion to refer to the 
fact that attempts to isolate fatigue from other influences 
affecting a curve of work are rendered difficult because of the 
presence of other complicating factors. Of these, practise is 
perhaps the most obvious and influential. Investigators have 
added, however, numerous other factors, such as recuperation, 
adaptation, momentum, swing, or fitness for work, warming-up, 
and spurts of various kinds. Extended accounts of these fac- 
tors will be found in Meumann (33, II, 8ff. and elsewhere), 
Schulze (40, 320ff.), and particularly in the writings of Kraepe- 
lin (26, 27) and his students. However patent and plausible 
these factors may appear from observation of our daily activi- 
ties, it seems probable that they have sometimes been invoked 
in explanation of work curves when actual demonstration of 
their existence is difficult, if not impossible.® In work curves 
obtained from school children it is certain that loss of interest, 

’For a comprehensive critique of the experimental literature upon work 
and fatigue the reader is referred to Thorndike (53). In ray translation 
of Offner (35) there will also be found a more general discussion of the 
whole topic of mental fatigue. 

*ThorDdike is especially severe in his criticism pf the numerous lesser 
factors exploited by the Kraepellnian school. 
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or ennui, and resultant carelessness complicate the performance 
seriously, and are often mistaken for the effects of true fatigue, 
in the sense of actual inability to work at a sustained level of 
efficiency. 

(h) Individual differences in the tcorJc curve. We have noted 
the presence of clear-cut individual differences in the speed 
and accuracy of computation; there are also individual differ- 
ences in the course of the performance. Thus, both Kemsies 
and Keller conclude that mass results should be subjected to 
scrutiny to detect individual curves of performance if reliable 
information is to be secured concerning fatigue and overpres- 
sure in the schools. The recent work of Miss Martyn (32), 
similarly, has shown that the introduction of a rest pause may 
be favorable to some /S^s and unfavorable to others, and also 
that the effect of fatigue may be met and masked in some 
by the presence in them of a strong permanent ‘set^ for accu- 
rate work. ^‘We may conclude, she says, ‘^that fatigue cannot 
be invariably estimated by diminution either in speed or in 
accuracy of work, since habit and method of working bear an 
important relation to its manifestations^^ (32, p. 434). Again, 
the results obtained by Miss Aral and confirmed by numerous 
investigators make it fairly certain that the most competent 
workers are the ones least affected by fatigue. 

These individual differences in susceptibility to fatigue have 
tempted some investigators to sort jS^^s into certain groups or 
^types’ of workers. If by ^types’ is implied that individuals can 
be sorted into ^water-tight compartments,’ the hypothesis must 
be regarded as of doubtful utility. Illustrations are seen in 
the work of Kemsies, who distinguishes between persistent 
workers who fatigue slowly and profit much by practise and. 
feeble workers who fatigue quickly and do not profit much by 
practise. Meumann’s own investigations lead him (33 : vol. 2, 
pp. 10-11) to posit three types of workers (quantitatively re- 
garded) : the first type attains maximal efficiency at the start 
and thence decreases with many fluctuations: the second at- 
tains maximal efficiency only after an interval (of a length 
depending ui)on the kind of work) ; the third attains maximal 
eftic eney only after a long period, perhaps several hours, of 
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work. The first type, then, is characterized by rapid adaptation 
and rapid fatigue, the second by slower adaptation and slower 
fatigue, the third by very slow adaptation and very great re- 
sistance to fatigue. The third type, he thinks, is probably more 
common in adult males, the first in women and children. 

(c) The work curve for continued computation. 1. Work 
without interruption. Oehrn found that when adults added 
continuously for 2 hours or more, maximal speed was attained 
on the average at about 28 min. from the start. Schulze finds, 
however, that with school girls aged 12.5 yearti, signs of fatigue 
appear even in the first 5 min. The total number of additions 
made per minute by 37 girls was 1850, 1871, 1863, 1785, and 
1772 for the 1st to the 5th minute, respectively. 

Schulze’s results with the same pupils for longer periods (50 
min. without pause) show a progressive decrease both of quan- 
tity and of quality of work (Table 73). These figures, which 
are selected from the 6th of a series of experiments, are based 
upon the very easy process of adding two l-place digits, so that 
practise has relatively little eftect, but fatigue diminishes effi- 
ciency. 


TABLE 73 

Efficienev In Addition: Five 10-Minute Periods (Schulze) 


PERIOD OP 

TEN, MINUTES 

TOTAL NUMBER OF 

ADDITIONS 

PERCENTAGE OF DE- 
CREASE OF QUANTITY 

OVER THE PREVIOUS 

PERIOD 

PERCENTAGE^ OF DE- 
CREASE OF QUALITY 

OVER THE PREVIOUS 

PERIOD 

I 

17.740 

1 


IT 

16,726 

1 5.7 

.09 

in 

15,855 

5.2 

.03 

rv 

15,485 

1 2.3 

.17 

V. 

15,134 

I 2.3 

.01 


The effect of continuous work upon a very difficult task de- 
pends upon the degree of practise previously attained, the 
actual length of the work and the general condition of when 
it is begun. Thus, Thorndike (51) induced 72 college students 
to multiply 3-place numbers mentally for about two hours, 
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with the net result that the work improved somewhat both in 
speed and accuracy; nevertheless, a rest of 30 min. effected an 
increase of about 5 per cent, in speed and a rest over night a 
still further increase in speed of about 7 per cent. But when 
the same iinostigator had 10 -8’s mentally multiply a 3 place 
by a 2 place number continuously for from 3 to S hours, or 
(with itauses foe meals) from 4 to 12 hours, only 3 S’s did 
as well at the end of thejr work period as when they had 
lested; the results showed, .as might be exjteeted, a compound 
of gradually lessening practise and gradually increasing fa 
tigue. Miss Aral, who mentally multiplied 4-placc numbers 
for 11 or 12 hours at a stretch after practise-effects had been 
lajgely eliminated, found that the time needed to work such 
examples was practically doubled at the end of eleven hours.” 

2. Work with interruptions. When repeated computation 
tests are made within an hour, the usual result is a progressive 
increase in the quantity, but a progressive decrease in the qual- 
ity of the work. Burgerstein’s figures (Table 74) furnish a 
typical example of the results for four 10 min. periods with o 
min. rest-intervals ’'etween periods. 


TABLE 74 


EMcieney in Addition anH Multiplication witJdn an Hour (Burgerstetn) 


PERIOD 

NUMBER OF FIGURES 
IN RESULTS 

NUMBER OF ERRORS 

PERCENTAGE OF 
ERROR 


28,267 

851 

3.01 

II. 

32,477 

1292 

3.98 

IIL- ^ ^ 

35,443 

2011 

5!67 

IV __ 

39.450 

2360 

5.98 


Miss Holmes’ uesults are similar, though, on account of com- 
puting errors of a different plan (‘serial’ errors counting but 


direction and as yet unpublished, Mr. 
1 aintei, aftei piellmluary (rials to remove moat of the effect of nractlse 
worked at difflcult mental multiplication, beginning late In the*eveiilng 
sihfp **Thp ** uniywsity work and continuing until the task became Impos* 

to^'imltli.H- gradual (with ability, for example, 

o - place numbers when 4-place were Impossible), but appeared 

WMlble^*^ collapse such that mental work of any sort was qX to- 



TEST 35 ; COMMUTATION [^ 79 ] 113 

\ 

as one error), her percentage of error averaged but 1.^, as 
against Burgerstein’s 3,^® 

The cdmmon interpretation of results like Burgerstein^s has 
been that practise increases the speed of the work, while fatigue 
increases its inaccuracy. But Ebbiftghaus (14, pp. 406f.) de- 
nies that practise could produce such marked increase of speed, 
and ascribes both the increase of speed an ! the decrease, of 
accuracy primarily to increased haste and carelessness. 

(cl) Effect of re^t-pauses. When, either from ennui or 
fatigue, efficiency tends to decline, a period of rest generally 
exerts a favorable effect. With school children, as would be 
expected, such a pause is favorable even after relatively short 
work, as is illustrated by the data of Table 75, which are de- 
rived by Bhrgerstein from Schulze. The effect of rest upon 
efficiency in mental multiplication after some two hours^ work 
has already been mentioned with reference to experiments with 
college students. The tests made by Friedrich upon 10-year-old 
pupils and by Kraepelin upon adults (26, pp. 16-17) furnish 
similar evidence of the effect of rest-pauses. 


TABLE 75 

Additions per Pupil, with and toithout a Rest-Pause (Burgcrstcin-Schuhe) 



* 1 

FIRST 25 MINUTES 

REST-PAUSE 1 

1 

SECOND 25 MINUTES 

1 

'First i.p.fnt 

1067 

5 min. 

1088 

Second 

1146 

None 

1042 

1 


(e) Efficiency at different periods of the day. Typical in- 
stances of the use of computation as a test for the fatigue- 
effects of the regular sciool program are afforded by the expe- 
riments of Friedrich, of Laser, and of Ebbinghaus. This 
method has been adopted in part to avoid the entrance of ennui 
and carelessness previously mentioned. 

*®Miss Holmes’ analysis of the errors showed that their Increase during 
the hour was due prrmarily to increased Inaccuracy In associative proc- 
esses, rather than to increased frequency of ‘slips of the pen.’ In general, 
errors of transcription were about one-third as numerous as errors of 
association. 
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Laser’s tests, at hourly intervals, of 226 pupils (aged 9-13 
years) in a KOnigsberg Burgerschule are summarfeed in Table 
76. Inspection shows that, save for the 5th period, the out- 
come is the same as that of the tests for an hour’s time by 
Burgerstein, viz. : a progressive increase in speed and decrease 
in accuracy of computation. 

TABLE 76 

Efficiency in Computation within a School Session (Laser) 


TEST AFTEB 
SCHOOL PERIOD 

TOTAL NUMBER *OF 
FIGURES ADDED 

TOTAL NUMBER OF 
ERRORS 

PERCENTAGE OP 
ERROR 

I 

34,900 

! 1147 

1 3.28 

11 

40,661 

1 1460 

1 3.59 

in 

43,124 

1 1713 

8.79 

IV 

43,999 

i 1796 . 

4.08 

V. 

45,890 

j 1668 

3.63 


Ebbinghaus, who sought to determine the desirability or un- 
desirability of a 5-honr continuous - school session in a Gynt- 
miium and higher girls’ school at Breslau, obtained results 
identical with those of Laser so far as the qualitative aspects 
are concerned, but differing somewhat as regards the quantita- 
tive. aspects, more particularly in that speed of computation 
reached a maitimum at the close of the 2d school period, to re- 
main thereafter almost constant or to fall off slightly toward 
the close of the session. Friedrich’s results lead him to advise 
lighter work in the afternoon session. Bellei found that boys 
and girls aged 12 solved problems in division more slowly arid 
less accurately in the afternoon than in the morning. Marsh 
tested but a few individuals, so that it is probably unsafe to 
make inductions from his data, which seemed to indicate a 
greater eflSciency in adding at noon than later in the day, and 
in multiplication at between 1.30 and 3 p. m. than at 6 or at 
10J30 p. m. Miss Martin had 6 S’s add for 15 min. at 10, 12 and 
4 o’clock, #ith the result that slightly more sums were com- 
pleted at 12 and somewhat fewer at 4 than at 10 ; the differ- 
ences are, however, inside the probable error. The work of the 
first 5 min. was relatively poorer in the afternoon, due, she 
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thinks, to a later entrance of Anrcgung at that time. The most 
authoritative laboratory study of efficiency in calculation at 
different periods of the day, however, is that of Hollingworth 
(20a), who had opportunity during his experiments upon the 
effects of caffein to watch the daily ciuves of whose work 
was done under exceptionally good conditions as regards elimi- 
nation of practise error. In the use of the constant-increment 
test (adding 17 to 50 2-place numbers) at 8, 10, 12, 3 and 5.30 
oVdock there appeared progressive fatigue amounting to about 
a 2 per cent, lengthening of the time at each trial, with a total 
lengthening of 7.50 per cent, in tlio case of 5 women and 10.5 
per ceiit. in the case of 5 men. In further use of the same test 
in a niore inlensive exi>enment (15 trials between 10.30 A. M. 
and 10.30 P. M.) there appeared, again, a lengthening of about 
10 per cent, toi^ard the end of the day. 

Heck tested 1153 New York school children (18) and. 573 
Lynchburg, Va., children (17) with a modification of the Courtis 
tests for the fundamental arithmetical operations. The New York 
tests lasted 10 min., those at Lynchburg 25 min., and they were 
distributed over various periods of the school session, particu- 
larly at 9, 11, 1 and 2.30 o^clock. The general result was an 
increase in quantity and a decrease in quality toward the close 
of the day; at New York, for instance, quantity increased by 
1.57, 1.G4 and 2.3G [)er cent, in the 2d, 3d and 4th periods, while 
quality decreased by 1.51, 1.41 and 2.28 i>er cent, in the corre 
spending })eriods. These differences are so slight as to be peda 
gogically negligible, in the opinion of Heck. The inferior qual- 
ity of the later periods is, he thinks, more likely a sign of 
lessened interest than of consumption of energy or any sort of 
fatigue-poisoning. Kather elaborate tests with computation 
and other forms of school work by Robinson in South Carolina 
show in general little evidence of actual loss of ability toward 
the close of the school session.^^ The same conclusion has been 
reached by Thorndike (45) from schoolroom tests at Cleveland, 
Ohio, and Scranton, Pa. He emphasizes the statement that 

“Consult the origin.^! for a discussion of the effects of recesses, lunches, 
gymnastics, Ringing, si)ecial incitement, etc., upon performance in such 
tests. The main conclusions are also summarized in JEdPs, 3: 1912, 
593-595. 
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“incompetence, mental fatigue, does not come in regular propor- 
tion tp the work done,” that feelings of fatigue are not meas- 
ures of mental inability, that disinclination to work does not 
signify inability to work. It may be questioned, however, 
whether this demonstration that pupils can work nearly as well 
at the end of school session as at its beginning is equivalent, 
as some writers have thought, to a demonstration that they 
should be expected to work as well at the later periods. 

A special study of fatigue in evening schools by Winch leads 
him to the conclusion “that evening work is comparatively 
unprofitable, and that a short time in class in the evening is 
sufficient, plus the labors of the day, to induce a low condition 
of mental energy.” 

Notes. — ^Those who have used computation tests have not 
sought, as a rule, to examine the mental processes involved in 
them. Oehrn, however, calls attention to the fact that practise 
in adding., (by the Kraepelin method) tends to induce quasi- 
automatic addition. . This circumstance, taken in conjunction 
with the. relatively small correlations between different forms 
of computation themselves, and between them and other abili- 
ties, including general intelligence, lends countenance to Wells’ 
objection (55) to accepting the computation test, without fur- 
ther qualification, as a measure of general mental efficiency. 

Wyatt’s ‘missing digit’ test forms an intii-esting modification 
of the computation test. In it examples in addition, subtrac- 
tion, multiplication and division are given in which one or 
more figures, both in the answer and in the body of the ex- 
ample, are replaced by dots: the task is to restore the figures 
covrecUy. The ioWowmg w\\\ serve to Wtustrate his material: 


2.94 

.867 

781. 


.42.6 



TEST 35 : COMPUTATION 


[ 483 ] )17 


REFERENCES 

(1) H. Aikins, E. L. Thorndike and Elizabeth Hubbell, Correlations 
among perceptive and associative processes. PsR, 9 : 1902, 374-382. 

(2) Tsuru Aral, Mental fatigue. CoUtynhiaConEd, No. 54. New York, 
1912. Pp. 115. 

(3) Bellei, Ulteriore contributo alio studio della fatiga mentale nei 
faneiulli. Revista sperm, di freniatria, 30: May, 1904. Sec suininary by 
Binet, AnPs, 11 : (1901) 1905, 369. 

(4) E. Bischoff, Untersuchungen iiber Uebuiigsfiihigkeit uud Ermlid- 
barkeit bel ‘geistiger* und ‘korperlicher* Arbeit. ArQcsPs, 22 : 1912, 423- 
452. 

(5) W. Brown, Some experimental results in the correlation of mental 
abilities. BrJPs, 3: 1910, 296-322. (Forms 3d part of his Use of the 
theory of correlation in psychology. Cambridge, 1910. Pp. 83.) 

(6) L. Burgersteln, Die Arbeitskurve eiuer Schulstunde. ZScGd, 4: 
1891, 543-564, 607-627. Also published separately in German, and In con- 
densed form In English as : The working curve of an hour. 

(7) L. Burgersteln und A, Netoiitzky, Handbuch der Schulhyglene, 2d 
ed. Jena, 1902. Pp. 997. 

(8) W. P. Bu^Tis, The correlations of the abilities involved in second- 
ary school work. ColnmbiaConPhPs, 11: 1903, 16-28. 

(9) C. Burt, Experimental tests of higher mental processes and their 
relation to Intelligence. JEPd, 1: 1911, 93-112. 

(10) C. Burt and R. C. Moore, The mental differences between the 
sexes. JEPd, 1 : 1912, 273-284, 355-388. 

(11) W. G. Chambers, Individual differences in gi-ammar-grade chil- 
dren. JEdPs, 1 : 1910, 61-76. 

(12) S. A. Courtis, The Courtis tests in arithmetic. Final Kept, Edu- 
caiional Investigation Goymnittee on School Inquiry, City of New York. 
Vol. I, New York. 1911-1913. Pp. 397-546. 

(13) M. E. Donovan and E. L. Thorndike, Improvement in a practise 
experiment under school conditions. AmJPs, 24 : 1913, 426-8. 

(14) H. Ebbinghaus, Ueber eine neue Methode zur Priifung gelstiger 
Fabigkeiten in ihre Anwendung bei Schulkindern. ZPs, 13 : 1897, 401-457. 

(15) W. S. Fox and E. L. Thorndike, The relationships between the 
different abilities involved in the study of arithmetic. Sex differences in 
arithmetical ability. ColnmhUiConPliPs, 11 : Feb., 1903, 32-40. 

(16) J. Friedrich, Untersuchungen Uber die Einflusse der Arbeltsdauer 
und der Arbeitspausen auf die geistige Leistungsfahlgkelt der Schul- 
kinder. ZPs, 13 : 1897, 1-53. 

(17) W. II. Heck, A study of mental fatigue in relation to the daily 
school program. Lynchburg, Va., 1913. Pp. 28. 

(18) W. H. Heck, A second study of mental fatigue in relation to the 
daily school program. PsCl, 7 : 1913, 29-34. 

(19) H. L. Hollingwortb, The influence of caffein on mental and motor 
efficiency. ArPsie), No. 22 (ColuynhiaConPhPs, 20, No. 4). New York, 
1912. Pp. 166. 

(20) H. L. Plollingworth, Correlation of abilities as affected by prac- 
tise. JEdPs,4:: 1913,405-414. 

(20a) H. L. Hollingwortb, Variations in efficiency during the working 
day. P«i?, 21: 1914, 473-491. 

(21 1 Marion E. Holmes, The fatigue of a school hour. PdSe, .3 : 1895, 
213-324. 



[ 484 ] ASSOCIATION; LEARNING AND MEMORY 

(22) E. E. Jones, The influence of bodily posture on mental activities, 
N. Y., 1907. Pp. 60. (Reprinted from ArPs(e), No. 6.) 

(23) E. Katzen-Ellenbogen, The mental efficiency in epileptics. Epl~ 
lepsia, vol. 3, 504-546. 

(24) R, Keller, Ueber den 40-Minutenunterrlchtsbetrieb des Gym- 
nasiums u. del* Indut^trieschiile in Winterthur. TnUagScHypy 2: 1906; 
298-330, especially 307-318. 

(25) F. Kemsies, Arbeitshygiene der Schule auf Grund von Ermtid- 
ungsmessungen. f^mAhPdPs, 2: 1898. Pp. G4. 

(26) E. Kraepelin, Ueber geistige Arbeit, 2d ed. Jena, 1897. Pp. 29. 

(27) E. Kraepelin, Die Arbeitscurve. PJiSd, 19: 1902, 459-507. 

(28) F. Krueger und C. Spearman, Die Korrelation zwlschen verschie- 
denen geistigen Leistungsfahigkeiten. ZPs, 44: 3907, 50-114. 

(29) H. Laser, Ueber geistige Ermiidung beim Schulunterrichte. 
ZScGd, 7: 1894, 2-22. 

(30) H. D. Marsh, The diurnal course of efficiency (Columbia Unlv. 
thesis), N. Y., 1900. Pp. 99. 

(31) (Gladys W. Martin, The evidence of mental fatigue during school 
hours. JEPd, 3 : 1911, 39-45, 137-147. 

(32) Gladys W. Martyn, A study of mental fatigue. BrJPSf 5: 1913, 
427-446. 

(33) E. Meumann, Vorlesungen zur Einfiihrung in die exp. Piida- 
gogikf Jst ed., 2 vols., Leipzig, 1907. Pp. 555 and 467. 

(34) A. Oehru, Exp* Studieu zur Individualpsychologie. PsArh, 1: 
1896, 92-151. 

(35) M. Offner, Mental fatigue. (Eng. trans.) EdPsMon. Balti- 
more, 1931. Pp. 133. 

(36) Louise E. Ordahl, Consciousness in relation to learning. AmJPs, 
22: 1911, 158-218, espkfally 194-202. 

(37) J. Reis, Ueber einfache psychologische Versuche an Gesunden u. 
'Geisteskranken. PsArb, 2: 1899, 587-694. 

(38) L. A. Robinso’n, Mental fatigue and school efficiency. BuU. Win- 
ihrop Nortnal and Industrial College of South Carolina, 5: 1911. Pp. 56. 

(39) K. Schulze, 5(K),000 Rechenaufgaben. Fine exp. ITntersuchung. 
Praktische Schulvlann, 44 : 1895, 340. 

(40) R. Schulze, Experimental psychology and pedagogy. (Eng. 
trans.) New York, 1912. Pp. 364. 

(41) B. R. Simpson, Correlations of mental abilities. ColumbiaConEd, 
No. 53. New York, 1912. Pp. 122. 

(42) W. Specht, Ueber klinische Ermiidungsmessungen ArOcsPs, 3 : 
1904, 245-339. 

(43) D. Starch, Transfer of training in arithmetical operations. 
JEdPs, 2 : 1911, 300-310. 

(44) Teljatnik, article in Russian. See for details, Burgerstein u. 
Netolitzky, 4; especially pp. 462-5. 

(45) E. L. Thorndike, Mental fatigue. PsR, 7: 1900, 466-482, 547-579. 

(46) E. L. Thorndike, Educational psychology, 2d ed., N. Y., 1910. 
Pp. 248. 

(47) E. L. Thorndike, Measurements of twins. Archives of Phil., 
Psych, etc., No. 1, Sept., 1905. Pp. 64. 

(48) E. L. Thorndike, The effect of practise in the case of a purely 
intellectual function, AmJPs, 19 : 1908, 374-384. 

(49) E. L. Thorndike, Practise in the case of addition. AmJPs, 21: 
1910, 483-486. 

(60) E. L. Thorndike, Mental fatigue. JEdPs, 2 : 1911,61-80. 



TEST 36: MmHOR^DRAWlNO 


[485] 119 


(51) E. L. Thorndike, The effect of continuous exercise and of rest 
difficult menial multiplication. JEdPs, 5: 1914, 597-509. 

' /452) E. L. Thorndike, Measurements of ability to solve arithmetical 
p4>blems. PdSe, 21 : 1914, 495-503. 

f <53) E. L. Thorndike, Educational Psychology, Vol. III. (Mental 
lyork and fatigue, etc.) New York. 1914. Pp. 408, especially Chs. 2 and 3. 

(54) U. Vogj, Ueber .\blenkbarkeit und Gewohnungsfilhigkeit. PsArh, 
k: 1901, (>2-201, especially 80-118, 131-135. 

P (55) F. li. AVclls, Technical a.spocts of experimental psycho-pathology. 
(U : 1908, 477-512. 

(50) F. L. Wells, The i elation of practise to indhidiial differences. 
23: 1912,75-88. 

(57) F. L. Wells, Standard tests of arithmetical associations. JPh^ 
4: 1907, 510-512. 

(58) AV. 11. Winch, Some measurements of mental fatigue in adoles- 
c(‘nt pupils in evening s< hool. JEdPs, 1: 1910, 13-23, 83-100. 

(59) W. 11. Winch, Accuracy in school children. Does imj)roveinent 
in nun)ori(al aeeiiracy ‘transfer?’ JEdPs, !•: 1010, 557-589. 

(00) W. II. AVineh, Further work on numerical accuracy in school 
( hildreii. Does improveineiit in numerical actiiracy transfer? JEdPs 2: 
1911, 2(;2 271. 

(01) K. S. Wooduorth and F. E. AVells, Association tests. P.9il/oa, 
No. 57, 1911. Pi). 85, especially 4t-48. 

(02) 8. AV.\ntt, The Quantitative inxestigaiion of higher mental proc- 
C-sev. /?)/y»s\(j- 191.3,109 133 


TEST 36 

Mirror-drawing, — The preceding tests of association deal 
with facility in producing unrestricted series, or in repro- 
ducing restricted series that have already been learned. The 
present test compels to form a new scries of associations that 
are opposed to associations stereoty])ed by several years of 
daily experience. 

More pariicnlarly, in tracing an ordinary drawing the move- 
ments of the hand are guided by the visual perception of the 
drawing, plus kinesthetic sensations sot up by the movement 
of the pencil. If the drawing is seen not directly, but in a mir- 
ror, the natural relations are reversed in certain respects, so 
that a new series of associative connections must be established 
between eye and hand. The rapidity and case with which these 
new connections are established may be taken as an index of 
iera'ning-capacity. 

Learning is often said to take place either by practise (trial 
and error), by imitation, or by some form of ideational control 
(instruction, reasoning, etc.). In the mirror-drawing test, the 
conditions preclude the use of imitation, and there is but rela- 
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lively little opportunity to employ ideational control ; whatever 
improvement appears is due primarily to a process of trial and 
error. 

The interesting phenomena of mirror-writing are mentioned 
in psychological literature as early as the 90’s, if not before, but 
the first use of mirror-drawing as a psychological experiment 
appears to be found in Henries article on the muscular sense 
(9) and in his monograph on tactual space perception of the 
same year, 1898. W. F. Dearborn (7), independently, expe- 
rimented with mirror-drawing in 1905, though his work was 
not reported until after other writers, likew^ise independently, 
had hit upon a similar idea. In addition to Dearborn, Judd 
(11, p. 99) Starch (16) and Hill (10) have called attention to 
the usefulness of mirror-drawing as a demonstration experiment 
to illustrate the acquisition of motor habits, the trial and 
error method of learning, the cross-transfer of practise-efifects, 
and the like, Burt, Yoakum and Calfee, Miss Weidensall and 
others have used mirror-drawing to test quickness of learning,^ 
and its correlation wdth sex, intelligence and other factors. 

Apparatus. — Mirror. Cardboard screen about 17x24 cm 
Suitable supports for holding the cardboard. Thumb tacks. 
Stop-watch. Two kinds of diagrams, printed in red ink, for 
tracing: (a) a 6-pointed star, (5) a set of 6 patterns, each 
based upon a ^oup of 12 points arranged at equidistant in- 
tervals in a circle about its central point, with guiding lines 
joining the 13 points in irregular fashion. [Mechanical counter. 
A strong prism (about 20 D.).] 

The six patterns resemble those used by Miss Calfee and Yoakum, but 
differ from them in eliminating the numberfng of the points. 8 Is directed 
from one point to the next by means of arrows and broken red lines, and 
does not have, therefore, to spend a portion of his time in hunting for the 
numbering to discern the order In which the points are connected. These 
patterns are somewhat more difficult than the star in so far as the direc- 
tion of the movemeut of the hand is not the same in the various trials — 
a matter of advantage, however, since the series of trials does not develop 
a specific memory for a given set of hand movements. On the other band, 
these patterns are less difficult than the star in so far as 8 Is not required 
to follow the directing lines exactly. The patterns also more nearly re- 
semble than does the star test the mirror test used by Burt, in which 8 

*For a discussion of prolonged adaptation to mirror-vision, see Strat- 
ton (18). 
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was required to puuch with a stylus through 8 or more orifices arranged 
in a circle about an orifice at the center. They are superior to Burt’s 
material in several respects. 

Whether the stars or the patterns are used will depend upon circum- 
stances. Either form of material may be used as supplementary to the 
other; thus, the star test may be used before and after drill work with 
the 6 patterns for an experiment to test the effect of practise. 

Preliminaries. — Pin the diagram out flat upon a table, di- 
rectly in front of 8. If the patterns are used, they should be 
taken in the order of their numbering. If the star is used, it 
should be placed with the cross-line that indicates the starting- 
point at the back (away from ;S^) and with the card square with 
the edge of the table. (This brings the star slightly ^out of 
true,^ as is intended.) Set up the mirror inclined sligiitly 
(about 5 deg.) from the vertical, just beyond the diagram. Ar- 
range the screen (see Fig. 64) so that it will cut off direct 
view of the diagram, but will allow him to see it clearly in Ihe 
mirror, and will not interfere with his hand in drawing. 

Method. — (a) With the patterns. Place the point of a lead 
pencil at the center of the diagram. Assist 8 to grasp the i>en- 
cil (permitting him to look only in the mirror). Instruct him : 
^*When I say ^now,’ move your pencil along the paper in the 
direction indicated by the red arrow till you reach the point 
at the end of the broken line; then follow the red line from 
that point to the next one, and so on till you have touched all 
12 of the points on the paper and come to the end of the red 
dashes. You don’t have to keep on the lines; they are put there 
simply to show you where to look for the points, but you mmt 
keep your pencil on the paper, and you must bring your pencil 
to each point before you go on to the next one. Work as rap- 
idly as you can. Don’t stop to figure out what you ought to do, 
but keep your pencil moving all the time.” Start the watch 
at the signal, and record the time for the entire diagram. Pin 
down the second pattern and continue until all six patterns 
have been traced. 

(6) With the star. Place the point of a lead pencil upon the 
cross-line of the star, and assist 8 to grasp the pencil (permit- 
ting him to look only in the mirror). Instruct 8: “Trace the 
outline of the star, starting in this direction [indicating, by 
pointing, the tip of the star at the right of the cross line . 
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Work as rapidly as yo\i can, Imt irj/ to Icxp on Ific line. Don't 
stop to figure out what you ought to do, but keep your i)encil 
going in some direction, and keep its point on the pajicr all 
the time.’^ Start the watch, and record the lime for the entire 
drawing. 

E may also note tlie time for each sixth of the pattern. lUU 
it is, perhaps, more desirable to supplement the total time by 
a record of the total number of corrective movements made by 
jS. Since these movements are often rapid, and of short extent, 
it i« necessary to use a mechanical or other form of counter to 
obtain the record. Press the counter every time moves to- 
ward the line.- 

For a standard test, make 6 trials with the right hand, using 
u fresh star for each trial. 

Variations of Method. — Make tests with the star before and 
after a drill series with the patterns, as suggested above, or 

^Every ‘error or movement nway from the line must, of course, be com- 
l>eusated for by a return movement. The idea is to register the number 
of these errors, or corrective movements. Changes of direction neccssl- 
by tlie jv*i1tern itself are, obviously, to be neglected 
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with cither forni of material make a first trial with the left 
hand ; follow with a series of 5 to 50 trials with the right hand,*^ 
then return to the left hand for a final test. Note how much 
[uactise effect has been ^transfeiTed’ from the one hand to the 
otlur. JMot a graph to show the effect of practise, both upon 
the time and upon the corrective movements. 

Treatment of Data. — In the standard form of test E has 
available G records. Several possibilities ai)i)ear: ^^s may be 
com])ared with respect to (1) their 1st trial, (2) their GUi trial, 
(3) all G trials taken collectively (sum or average), or with re- 
si)e( t to their rate of improvement, by computing the per cent, 
of gain either (4) in the Gth, com])ared with the 1st trial, or 
(5) in the average of the last three, com])ared with the average 
of the first three trials. The third method was found by l>urt 
to yield the best correlation with intelligence. On the other 
hand, the 2d method would seem to liave some merit, since 
Yoakum and Calfee conclude <!ia( ^‘llui lime (onsnmed in the 
first trial is an individual variation; tlmt of the last [Gth] more 
nearly represents the individual’s place in the group.^^ Until 
we have more investigations on this point it would be better for 
E to try more than one method of ranking >8’s and to select the 
one which gave the most favorable results. 

Results. — (1) The best norms for the patterns are supplied 
by the results of Yoakum and Calfee, embodied in Table 78; 
results from a more limited number of college students with the 
star test are showman Table 77, and for other grouj)s in Tables 
79 and 80. 


TABLE 77 

Effect of Practise on Speed in Mirror-Drawing. College Students 

(Whipple) 



NUMBER 

1st 

LEFT 

1st 

RIGHT 

2d 

right 

3d 

RIGHT 

4th 

RIGHT 

5th 

RIGHT 

Men ! 

11 

169 

127 

108 

96 

80 

67 

Women ..i 

1 

23 

149 

1 127 

87 

76 

67 

67 

1 


*If desired, the 6 patterns may be used, turned to briiier the other edges 
at the back, in order to provide drill without direct repetition of the same 
diagram 
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(2) Individual differences in performance are striking; thus, 
in the star test the time consumed in making the first tracing 
ranged, in the author’s tests of 34 students, from about 50 sec. 
to more than 8 min. In the larger group of students examined 


TABLE 78 

limes, in Sec., for Mirror-Draioing (Yoakum and Calfee) 


GROUP 

TRIAL 

I 

II 

III 

IV 

I V 

VI 

AVER. 

I 

Median 

243.0 

121.0 

93.0 

82.0 

68.0 

50.0 

110.33 


M.V. 

94.9 

1 45.5 

28.1 

34.7 

24.7 

17.1 

36.57 


Slowest 

517.0 

245.0 

205.0 

180.0 

158.0 

113.0 

210.00 


Fastest 

69.0 

51.0 

41.0 

43.0 

40.0 

32.0 

53.66 

II 

Median 

92.0 

65.0 

48.0 

41.0 

35.0 

28.0 

54.70 


M.V. 

64.1 

33.9 

26.6 

19.3 

21.9 

14.2 

27.40 


Slowest 

700.5 

337.5 

303.5 

153.5 

201.8 

171.0 

242.37 


Fastest 

31.5 

23.5 

19.3 

18.3 

17.8 

17.0 

23.95 

III 

Median 

167.5 

105.0 

80.0 

68.0 

56.0 

48.0 

97.83 


M.V. 

104.2 

39.3 

80.3 

19.7 

19.9 

13.5 

33.38 


Slowest 

752.0 

277.0 

270.0 

175.0 

121.0 

105.0 

193.33 


Fastesf 

72.0 

49.0 

40.0 

34.0 

33.0 

23.0 

46.87 


Group I coitiprised 30 elementary school boys. Group IL 52 women, 
and Group III, 51 men in the freshman class of the University of Texas. 
The averages for each group in each trial are not here reproduced. 


at Texas differences range from 31.5 to 752 sec., while the fastest 
college girl tested by Miss Weidensall had a record of 18 sec., 
as compared with 2072 sec. for the slowest reformatory woman 
(TaWo 79). These differences, as inspection of the tables will 
show, are greatly reduced after a little practise. 

(3) Dependence on sex. That girls decidedly surpass boys 
and that women decidedly surpass men is shown in all the pub- 
lished results in mirror-drawing, with the exception of two 
groups reported by Burt and Moore, and in them certain diver- 
gencies in method and in other test conditions offer a sufficient 
explanation o^ the apparent exception. Miss Calfee’s averages 
for six trials give for the freshmen women 64.4 sec., P.E. 22.3, 
lor the freshmen men 101 sec., P.E. 28.5. She finds that only 
6 per cent, of the men i*each the women’s median, while 90.4 
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per cent, of the woihen reach the mea’e median. It is not onlj^ 
possible, bnt probable, that this sex-difference is in some part 
doe to greater familiarity of women ^th the use of the mirror. 
Bort believes that there is also an innate sex difference at work. 

(4) Dependence on practise, (a) General practise-effects. 
The tables given above show that even a single trial produces 
a decided 'reduction in time: the median time for elementary 
school boys, for example, is cut in halves in the pattern test, 
while that for men and women is reduced one-third by the 
first trial. (See Pig. 65.) The long practise experiment con- 
ducted by Starch with the star test phows (Pig. 66) that the 
reduction is rapid at first, then slower, and that maximal 
speed is not attained for a long time, apparently not until some 
90 trials (Starch’s curve represents a series of 100 trials, one 
per day). 

(6) Individual differences in practise-effects. Practise curves 
compounded of the performances of a group of S’s show a 
smooth drop (see Pig. 65), but the curves of individual S’s are 
not necessarily of this form : on the contrary, it is possible, as 
Yoakum and Calfee have shown (22, p. 290), to separate 8’b 
into groups that show the 2d trial slower than the Ist, or the 
3d slower than the 2d, etc. These investigators summarize these 
facts by saying: “Some /S’s gain control of the situation by a 
fairly regular procedure; others temporarily lose control at 
some point in the series. The majority of the latter [ose control 
at the fourth or fifth trial in a series of six tests.” It follows 
that the rank-order of S’s in any one trial does not correlate 
perfectly with their rank-order in any other trial; actual corre- 
lations computed by Yoakum and Calfee between the first and 
subsequent trials are 0.79, 0.76, 0.74, 0.64 and 0.59 for the 2d, 
3d, 4th, 6th and 6th trial, respectively. The correlation be- 
tween the first trial and the average of all 6 trials is given by. 
them as 0.93. 

(c) Cross-education. A considerable amount of practise 
gained with the one hand is transferred to the other (unprac- 
tised) band. Thus, Starch’s 100-day practise with the right 
band effected an improvement in it of 92 per cent, in accuracy 
apd of 84 per cent, in speed. A single left-hand record, made 
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FIO, G5. THE EFFECT OF PRACTISE DURING SIX TRIALS UPON THE AVERAGE 

SPEED OF MIRROR-DRAWING. (From Yoakum and Calfee) 

The abscissas represent the six trials, running from left to right. The 
ordinates repreS'ent time in sec. ‘E’ Is the curve for the 30 elementary 
school boy.s, ‘B* for the 51 freshmen men, ‘G’ for the 52 freshmen women, 
‘T’ for the 103 freshmen collectively. 
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at the expiration of this period, showed, in comparison with a 
single left liand record made before practise began, an improve- 
ment of 81 per cent, in accuracy and of 85 per cent, in speed. 
There is, however, nothing sur])rising in this so-called ‘cross- 



IIO. on. THE EllECT OF LONG PUACl'ISE UPON MIRROR-DRANMNO. 

(From starch) 


education,' since the fracing of the star in the mirror depends 
primarily upon co-ordinations established in the central ner- 
vous system: in other words, the transfer is only an outwardly 
apparent transfer; in reality, the same factors are at work in 
the control of either hand. 

{(I) Persistence of practise. The effect of even a shoi t period 
of practise in mirror-drawing is very persistent. Thus, Burt 
administered 6 tests in succession, during which the average 
speed fell from 103 to 39,5 sec. Twelve weeks later, two tests 
were given in succession ; the average speed developed was 34.5 
sec. in the first, and 27.4 sec. in the second : in other words, the 
7th test surpassed the 6th, made 12 weeks previously — a condi- 
tion found in the records of 16 out of 26 boys. The extent to 
which this persistence of practise-effect was shared by Burt’s 
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is further indicated by the correlation of 0.52 between their 
standing before, and their standing after the 12-week interval. 

HilFs work (10b) shows that the skill developed by one trial 
a day, continued for 50 days, is so persistent that after an in- 
terruption of three years the first trial in relearning is as fast 
as the 32d and more accurate than the 50th trial of the original 
series, and that in four retrials a speed and accuracy has been 
regained that is equal to the final records of the original series. 
Mirror-drawing seems, therefore, to resemble neuro muscular 
habits, like skating, typewriting, etc., in the manner in which 
skill once developed is retained with little loss over long periods, 
rather than the associative connections of ideational life with 
their relatively lesser persistence. 

(5) Dependence on intelligence, Burt reports a correlation 
between speed and estimated intelligence of 0.67, P.E. .07, for 
elementary school boys, and of 0.54, P.E. .14, for preparatory 
school boys. In another group of English school children a 
correlation of 0.60 was found, according to Burt and Moore. 
Miss Calfee, however, found no such relations in her group of 
elementary school children chosen to duplicate BurPs condi- 
tions: here the correlation with school grades was virtually 
zero (0.07) ; similarly, in the college students the correlation 
with grades was — .07 in the case of the men and 0.19 in the 
case of the women. The author was able to discern no constant 
differences between the work of five dull and five bright boys. 

(6) Delinquents. Comparative study of the star-test (5 suc- 
cessive trials) with college girls, maids in college dormitories 
and girls at Bedford Hills,. N. Y., Reformatory, conducted by 
Miss Weidensall, reveals a number of interesting results. From 
advance sheets of hei; manuscript, for which I am indebted to 
Dr. Weidensall, I have selected data referring primarily to the 
time records only^ (Tables 79 and 80) . The first of these tables 
shows that, both in the first and in the last trial, and whether 

^Dr. Weidensall expects to publish also data for the number of errors 
(corrective movements), and for the degree of ‘precision’ with which the 
lineds followed. Precision has been measured by ascertaining the total 
number of cm. in the contour of tbe star in which, for distances of 3 or 
more consecutive mm., the tracing remained within 2 ram. either w^ay from 
the red line. 
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maximal, minimal, median, average or upper or lower quartile 
is considered, the three groups are invariably arranged in the 
same order — students best, Bedford women last and the maids 
intermediate. The second of these tables shows that there 

TABLE 79 


Times, m Sec., Used in the Star Test by 36 College Girls, 16 College Maids 
and 69 Bedford Reformatory Women {Weidensall) 



COLLEGE GIRLS 

1 

COLLEGE MAIDS | 

REFORMATORY WOMEN 


1st Star 

5th Star 

1st Star 1 

5th Star 

1st Star 

5th Star 

Fastest . 

18. 

7. 

36. 

21. 

59. 

I 36. 

Upper Q. 

41. 

17.5 

54. 

29.5 

203.6 

80. 

Median . 

66. 

28.7 

127.5 

44.5 

420. 

117.2 

Average 

82.6 

31.3 

133.6 

48.6 

473.1 

124. 

Lower Q. 

110. 

39. 

161. 

69. 

627. 

148. 

Slowest- 

252. 

76. i 

409. 

85. 

2072, 

436.* 


♦With two failures in addition. 


exists a good cori'espondence between both the time and errors 
for the star test and the classification made by the institution 
into three groups depending on outlook for reformation : the 
differences are more striking in the first than in the fifth 
tracing. 

TABLE 80 


Scores in the Star Test for Three Croups of Bedford Reformatory Women 

{Weidensall) 


INSTITUTIONAL CLASSIFICATION ^ 

1 FIRST 

STAR 

FIFTH 

STAR 

Time | 

1 Errors 

1 

! Time 

1 Errors 

Most capable and promising 

320.9 

117.7 

105.4 

36.0 

Women with illegitimate chil- 




dren under 2 yrs. of age 

562.9 

211.3 

123.1 

45.G 

Backward and mentally feeble. 



Unpromising 

610.5 

264.4 

127.2 

i 

55.1 


In addition to these quantitative results, the star test has 
proved to possess a value in a perhaps unexpected direction, 
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viz.: as a device for sorting out 8’b of the unstable and less 
tractable type. 


On this point Dr. Weldeiisall writes : '‘This test isolates better than 
any we have tried at Bedford those who are incapable of sustained effort 
under ditiiculties. It isolated, of course, the low-grade feeble-minded, for, 
no matter bow hard they try, they do not succeed in tracing a precise 
star. The epileptics have a characteristically bad time and their stars 
are all 'knotted up’ with ‘blind spots’ where they weie caught and held 
indefinitely. Chiefly, however, is the test of interest in the case of those 
who are bright enough to trace the star well, but too unstable to do so. 
These are invariably the girls who are difficult to manage in the institu- 
tion. The tracing goes well enough until suddenly the pencil at some hard 
point starts off in the wron'g direction. The subject then tugs and pulls, 
grows more and more irritated, disturbed and excited, makes big black 
circles and finally throws down the pencil and gives up. When calmed, 
praised and urged to try again, she will continue and usually in the end 
draw a fairly good fifth star. This behavior in tracing the star is typical 
of their behavior in the institution when the pressure of discipline or re- 
sponsibility becomes the least bit too exacting.” 

(7) Relation of speed and accuracy. The curves reproduced 
from Starch show that practise produces a reduction in the 
number of corrective movements that parallels fairly closely 
the reduction in time. Correlations between time and errors 
obtained by Miss Weidensall are for the students 0.63, for the 
maids 0,87, for the reformatory women 0.61. My own work 
with college students has given a correlation of 0.86, P.E. .04. 

(8) Reliahility. Burt and Moore give this coefficient as 0.52. 
The method used at Texas is evidently superior, since the coeffi- 
cient of relation between the first and second test, as above 
stated, amounts to 0.79, and thus assures satisfactory relia- 
bility. 

(9) Various correlations. Miss Calfee^s tests of Texas fresh- 
men included three tests previously used by Burt, viz. : card 
dealing, card sorting and alphabet sorting. Correlations found 
by Burt between mirror-drawing and these three tests when 
applied to school children were 0.40, 0.34 and 0.29, respectively : 
those found by Miss Calfee for school children were only 0.11, 
0.26 and 0.06, for freshmen men 0.19, 0.11 and 0.22, and for 
freshmen women 0.37, 0.20 and 0.29, respectively. Save, then, 
for the last mentioned correlation, her figures are invariably 
lower than those of Burt. Other ‘corrected’ correlations re 
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ported by Burt for mirror drawing (average correlations for 
various groups) are : tapping 0.74, dotting apparatus 0.92, spot- 
pattern test 0.75, immediate memory 0.38, discrimination of 
pitch 0.66, comparison of line lengths 0.55, esthesiometer 0.38, 
discrimination of lifted weights 0.30. 

(10) Qualitative aspects. EfiSciency in mirror-drawing may 
I'esult from the actual formation of new visual-motor co-ordi- 
nations (indeed, some iS^s after executing a number of drawings, 
find that, for a short time immediately thereafter, these new 
co-ordinations interfere with normal drawing or writing) ; but 
efficiency may also result, at least in the star test, from, the 
voluntary inhibition of visual control in favor of kinesthetic 
control, i. e., by thinking the drawing of a star in motor terms, 
as if w^orking with the eyes shut. Or, the hand-movements may 
be started in this manner and then carried out by visual* con- 
trol from the mirror. Finally, adults occasionally control the 
drawing ideational ly, i. c., by applying inferred properties of 
reflection by mirrors. 

It is evident that the existence of these qualitative differences 
may affect the test in such a way that the quantitative data for 
different may ^measure^ different mental processes. 

Very slow get ^caughF at certain difficult points of the 
drawing, where they make a long series of futile attempts to 
start in the right direction. Here the normal visual-motor 
control is too persistent to be readily broken or ignored. 

Notes. — A further study of the associative connections in- 
volved in mirror-drawing may be made by the use of dot -tapping 
through a prism or of tlic various forms of mirror-W'i iting.^* 

For the first test, let shut his left eye, and strike repeatedly 
with his right forefinger at a mark on the w^all or table-top. 


®On mirror-writing, consult Abt, Allen, Downey, Laprade, Locbte, 
Ordalil, Rowe, Strack, Weber, and Wegener. The most elaborate statis- 
tical study is that of Loclite, who examined 2804 pupils in Berlin, and 
found, for children aged 6-7 years, 13.2 per cent, of spontaneous left-hand 
mirror-writing in boys and 25.4 per cent, in girls, but for children aged 
13-14 years, oidy 0.7 per cent, in boys and 35 per cent, in girls. The ten- 
dency toward this tyi)e of \vriting appears, therefore, to decrease with 
age. and to be more evident in girls than hi boys. 

The most elaborate qualitative analy.sis of the various ‘controls’ used In 
writing is that of Miss Downey. 
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making about one stroke per second, after the manner pre- 
scribed in the test of precision of aiming (No. 11). After this 
rhythmic movement has become well established, and without 
interrupting it in the leasts place suddenly before his eye a 
20 D. prism, with the base toward his nose. The mark is thereby 
apparently displaced some 10 cm. to the left. Count the num- 
ber of strokes that makes before he hits the mark again (with 
the prism kept before the eye) . Similarly, count the number of 
strokes necessary to hit the mark again when the prism is re- 
moved. 

For the second test, try any or all of the following: 

(1) Close the eyes and write with both hands sfmultane- 
ously. Cases will then appear, particularly in young children, 
of spontaneous mirror writing (writing which reads correctly 
when held before a mirror) with the left hand. If this ap- 
pears, see if 8 can write normally with the left hand when his 
eyes are closed. 

(2) Show 8 a sample of mirror-writing. Explain its nature. 
Ask him to write in a similar manner, first with his left, then 
with his right hand. 

(3) Write with both hands simultaneously, but with the 
left intentionally in mirror- writing. 

(4) Bead normal writing when seen only as refieoied in a 
mirror. 

(5) Write normally while watching the writing in the mir- 
ror, i. e., with hand and paper hidden from dii’ect observation, 
as in the star test. 
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TEST 37 

Substitution. — Tliis test is one of many that may be devised 
to measure the rapidity with which new associations are formed 
by repetition. The name coramonly applied to the test arises 
from the process that it involves, in which 8 is called upon to 
substitute for one set of characters (letters, digits^ familiar 
g;eoir.<dri('a] forms, elc.) another set of characters in accordance 
wiGi a plan set before him in a printed ke}’. The jjroeedure 
from most memory tests or exercises of memorizing iu 
iliat the coniiectioiis indicated by the key are not committed 
to memory at the outset, but acquired gradually by use as the 
test proceeds. 

The principle embodied in such a test obviously admits of 
numerous variation's in detail of application. One form of 
Eubstitution, the replacement of a set of letters by another set 
of letters, was used by Lough (7) in 1902 for a class exercise in 
learning. Another and more elaborate form in which letters 
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distributed like those of a typewriter keyboard are to be asso- 
ciated to numerals is reported by Starch and Dearborn to have 
been devised by Jastrow and used several years ago in the Wis- 
consin University Tiaboratory. In recent years several varia- 
tions, some simpler, some more difficult, have appeared. 

The substitution test seems primarily to have been developed 
as a useful demonstration and class experiment for the study 
of the psychology of learning and of the practise curve (Dear- 
born, Btarch, Lough, Munn, Kline). It has also been used to 
study racial differences (Baldwin, Pyle), to trace the effect of 
dental treatment on general ability (Kohnky), to compare 
delinquent and normal individuals (Baldwin, Weidensall) and 
as one test of the capacity of working children (Woolley and 
Fischer). Incidentally, of course, the relation of learning 
ability to age, sex and school training has been the object of 
investigation. 

Three forms of test material are here presented : the first 
and second, which are modifications of a form devised by W. F. 
Dearborn (3), may be used with adults or older children; the 
third, which has been devised by Mrs. Woolley and used by 
Miss Kohnky and Miss Weidensall as well as Mrs. Woolley, 
is much simpler and better adapted for younger or less capable 
children.^ 

A. STANDARD FORM FOR INDIVIDUAL PROCEDURE (SYMBOLDIGIT 

test) 

Materials. — Stop-watch, preferably split-second. Cover- 
board with key. Test strips. 

The co^ er-hoard. about 18 x 3G cm., is so constructed as to furnish a sort 
of ‘tiiimer throujzli 'which the test-strips may slide as fast ns they are writ- 
ten ; it also carrii's a printed key consisting of 9 circles, within each one 
of which is a digit (IToui 1 to 0) and a symbol (square, asterisk, etc.) 

The test-strips, about 11.5x50 cm., contain forty 5-place series of sym- 
bols like those of the key, together with forty 5-place empty squares. 


Uf a test more difficult than any of those described here is desired, 
reference may l>e had to the form proposed by Gray (4) and used with 
some modification by Baldwin (1). The Maltese Cross test arranged by 
Mrs. Squire, and also tried by Carpenter, proved undesirable, apparently 
in part because it was too easy. Much the same thing may be said of her 
Colored Forms test, which represents still another quite simple variety 
of substitution test. 
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Method. — Lay the cover-board upon the table. Insert a test* 
strip in such a manner that the first (top) line, of characters 
conies just below the lower edge of the cover and hence just 
beneath the key. 

Cover the key and do not allow S to examine it before the 
test, save as specified below. 

Give f) the following explanation : ^‘You will find before you 
on the table a card on which there are nine circles. In each 
rircle you will find one of the numbers from 1 to 9, and a 
symbol, i. c.. a small character or drawing. Then, you will find 
a strip of paper with rows of the same characters, and with 
empty squares beside them. What you are to do is to write 
in these empty squares the numbers that correspond with the 
(haracters. Kee]) at Avork continuously, as fast as you can, 
until you have filled in all the empty squares on the paper. Of 
course, you will have to look back and forth from the paper 
to the circles to find out what number to use, iinh ss you can, 
after a while, remember some of the numbers without looking 
at them 

With young ^S'’s, this verbal explanation will be insufficient 
to make tlie task clear. It will do no harm, in such cases, to 
show S, for a brief instant, the card of circles and a test-strip 
ihat has already been filled out. Let him see them just long 
enough to make the instructions clear, but not long enough to 
permit him to learn any of the combinations. 

Start the watch when starts the first line: keep the watch 
in view, but out of fS^'S sight: record, witliout stopping the 
watch, the position of the second-hand Avhen completes every 
•itli line (indicated,* for this purpose, by a heavier division-line 
in the test-strip). 

As fast as ^ finishes a line (or two lines), push the strip 
forward to bring a fresh line of symbols into jiosition at the 
lower edge of the cover. 

When the 40th line is written, conceal the key; immediately 
turn over the test-strip, write on it the digits 1 to 0, and ask ^ 
fo place above each digit the character that accompanies it. 
Ascertain, if possible, whether S relied upon visual, auditory, 
visuntouditory, or some other type of associative imagery. 
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Treatment of Data. — Check up the test-strip for errors. 
Compare S’s Mith respect to (1) their time for the Avhole test, 
(2) their gain in the last, as related to their speed in the first 
5-line section, (3) their accuracy, and (4) their knowledge of 
the symbols (crediting 1 for each symbol correctly reproduced, 
and 1 for each pair of transposed svinbols). Plot graphs show* 
ing the variation in speed for the eight sections. 

D. FORM FOR GROUP TESTS, OR FOR SUPPLEMENTARY INDIVIDUAL 
TESTS (digit-symbol TEST) 

Materials. — Printed form, at ihe top of which arc shown b 
circles, as in Form A (save that different symbols are used), 
and in the body of which is })rovided, in Iwo colninns, a series 
of forty 5-place numbers and forty 5-pIace blank s(]uares in 
which the appropriate symbols are to be placed. Stop-watch. 

^Iethod. — For individual tests, give instructions similar to 
those for Form A, with such modifications as the altered ar- 
rangement of the material necessitates. Make clear, (^sjiecially, 
that the second column is to be filled out the jnomeiit that the 
first is completed. 

For group tests, suiiplement the instructions hy an adequate 
blackboard explanation, jireferably with an illustration so de- 
vised as not to give information concerning the symbols to be 
used. Have the papers distributed, face down, to be turned 
over only at the command to start. Work by the time-limit 
method, Rllowiug 4 min. for the test. Instruct to place an 
oblique mark at the point reached when the command “mark'^ 
is heard. Give this signal every 30 sec., so that the work is 
divided into 8 periods of 30 sec. each. Conclude with the 
symbol-test as in the individual method. Plot curves for 30 
sec. intervals. 

Variations of Method. — (1) Cut off the top of the form and 
glue the pattern of circles on a sheet of cardboard, as in Form 
A. Cut and paste the two test-columns to form a single long 
column, as in Form A. This will permit check-tests, comparable 
with the standard method, save that here symbols, there digits 
are written. 
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(2) Repeat either Forip A or Form B after an interval of 
several hours, days, or weeks, to compare the permanence, in 
different of the associative connections established in a 
single trial. 

(3) Repeat Form A until the associations are firmly estab- 
lished, and the digits can be written rapidly without seeing 
the pattern. Ascertain whether the use of Form B will then 
develop interference of associations. 

(4) Cover up the key in either Form A or Form B when the 
last section (last quarter or last eighth) of the test is reached 
so as tot produce a test of ability to continue the work from 
memory, like that described for Form C. 

0. CINCINNATI SYMBOL-DIGIT TEST 

Materials. — Four test sheets of geometrical forms, each con- 
taining ten row’s, 5 units per row, of nine different forms. 
Cardboard with printed key. Cardboard cover. Stop-watch. 

Method. — Put before /S' the first test sheet and set the key 
where it can be seen easily. The following are the instructions 
then given by Woolley and Fischer : 

^‘You see this page of figures [forms]. Now on this card I 
have the same figures, but each figure has a number in it. What 
I want you to do is to w rite in each figure on this page the 
number that you see in the same figure on that card. For in- 
stance, what figure would you put in here? [E points to one 
of the figures Avhich might easily be confused with another 
one — the inverted triangle or the U, and corrects S if he makes 
a mistake.] And in here [pointing to one of tile ^uniqne^ 
figures] ? I want you to begin here at the top of the page and 
fill the figures in, in rows, just as you come to them. As you 
finish each row’, I wdll cover it up with this piece of cardboard, 
this way. Now’ begin, and see how^ fast you can get the whole 
page done.^^ 

The time is taken from the moment 8 begins to look on the 
key for his first number to the moment he writes the last one. 
The second test sheet is then given with the instruction : ^^Now 
fill in this page the same w’ay, and see if you can do it faster 
this time.” 
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The third test sheet follows, with the instruction : ^Till in 
this page and try to do it still faster. - When you finish this 
page, I will take the card away, and then I want you to try to 
fill in the last page just from memory.” 

is allowed to correct any errors that he may note Iwfore 
the line is covered. The covering is done to insure that each 
line in the first three sheets is done from the key and each line 
in the last sheet from memory, never from the previous records. 

Variation of Method. — If S scores less than 98 per cent, 
accuracy on Sheet 4, it is instructive to give another drill sheet, 
followed by a second test of substitution from memory, and to 
continue alternating sheets filled in with the key and without 
the key until this degree of accuracy is secured. The number 
of extra trials needed forms a useful indication of relative 
learning capacity, especially in the case of rather incom- 
l»etent y8's. 

Treatment of Data, — For eavh test sheet, taken separately, 
is figured the time, the accuracy and an index of efficiency com- 
puted from the time and the accuracy. Accuracy is calculated 
by subtracting from 100 per cent. 2 per cent for each error or 
omission. The index is found by dividing the obtained time 
by the accuracy. In the first three sheets this index may be 
regarded as indicating approximately the time needed to make 
the substitutions without error. In the fourth sheet the index 
i^ evidently a more arbitrary measure, since an error in sub- 
stituting from memory might not be remedied by any amount 
of extension of the time. 

Speaking generally, the learning capacity of a given iS is 
indicated not alone by his performance with the 4th sheet, but 
also by his index for the first three sheets, f. e., while the 4th 
sheet shows whether the associative connections have been made 
correctly or not, the work with the other sheets shows how 
long a time was used in establishing these connections.^ 

Results. — (1) Xonns for the three substitution tests are nov 
available in sufficiently satisfactory form for most purposes. 

‘It would soeui possible tiuit some measure of learulug capacity mipTlit 
be calculated from tlie relation between performance with tbe 4tU and 
with the other sheets, though the Cincinnati investigators have contented 
Uiemselves with the treatment quoted. 
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Tables 81 and 82 give results for college students ’with Form B. 
Tables 83 and 84 give I^yle's results with Form B and Form A, 
respectively, for both sexes and ages from 8 years upward. 
Table 85 gives some of the more important norms compiled 
at Cincinnati for 753 children 14, and G70 children 15 years old 


TABLE 81 


tiUhHtiluthn 7'csL Xvinlcr of Symbols Writ tau Form B, Group Mclhod 

(Whipple) 


THIETY-SEC. PERIOD 

iBT 

2d 

3d 

4th 

5th 

6th 

Tth 

8th 

TOTAL 

SYMBOL 

scorp: 

Average, 12 men 

13.7 

16.1 

14.6 

16.3 

14.8 

17.2 

16.7 

17.9 

127.3 

8 

Average, 28 women 

13.9 

15.4 

16.0 

17.9 

16.0 

17.0 

16.8 

19.0 

132.0 

8.2 

Fastest individual 

10.0 

21.0 

22.0 

18.0 

23.0 

20.0 

25.0 

26.0 

165.0 

9 

Slowest individual 

11.0 

13.0 

8.0 

10.0 

> 12.0 

10.0 

11.0 

13.0 

95.0 

3 


TABLE 82 

Substitution Test. Speed in Seconds. Form B. Individual Method 

(Whipple) 


section of 6 LINES 

1 1st 

1 

2d I 

1 I 

1 4th 

1 6th 

I 6th 

j 7 th 

j 8th 

TOTAL 

Average, 13 men 

54.0 

1 

46.0 

1 

45.8 

44.8 

46.1 

44.4 

47.7 

44.3 

373.1 

Average, 5 women 

45.8 

41.2 

40.6 

38.6 

43.4 

37.6 

36.6 

35.0 

318.8 

Total, 18 cases 

51.8 

44.7 

44.3 

43.1 

45.4 

42.5 

44.6 

41.7 

358.1 

Fastest individual 

42.0 

35.0 

33.0 

30.0 

36.0 

129.0 

31.0 

34.0 

270.0 

Slowest individual 

63.0 

58.0 

59.0 

61.0 

1 

62.0 

53.0 

I 

60.0 

65.0 

481.0 


TABLE 83 

Correct Suhstiiutions Made itf 60 Sec. DigiUSymbo} Teat (Pyle). 


SEX 

AGE 

8 

■i 

10 

11 

12 

13 

14 

j 15 

16 

17 

is! 

1 

ADULT 

* 

Cases 

34 

58 1 

50 

49 

56 

62 

48 

35 

31 

14 

17 

67 

Male 

Aver. 

10.3 

12.6 

15.4 

16.3 

19.1 

22.621.1 

24.7 

24.8 

23.8 

28.7 

29.3 


A. D. 

35 

4.1 

3.9 

3.6 

5.1 

5.8 

4.5 

4.6 

5.4 

4.3 

3.5 

8.7 


Cases 

37 

61 

58 

49 

68 

49 

46 

34 

46 

38 

29 

88 

Female 

Aver. 

13.0 

15.7 

18.8 

18.5 

22.723.4 26.8 

26.8 

27.5 

28.5;25.9 

32.2 


A. D. 

3.2 

4.1 

4.4 

4.1 

! 4.9 

1 ,i 

5.2 

i 

5.0 

4.7 

5.3j 5.7j 7.0^ 

4.2 
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TABLE 84 

Correct Substitutions Made in 60 Sec, SymboUDigit Test (Pyle). 


BEX 

AGE 

1 

1 8 

1 

9 

10 1 

11 

12 

13 

14 

I 

15 

16 

17 

18 

ADULT 


Cases 

37 

72 

76 

62 

75 

78 

59 

45 

38 

20 

17 

56 

Male j 

Aver. 

10.0 

13.2 

16.5 

17.7 

119.3,20.7 

23.3 

25.8 

27.8 

26.1 

28,0 

33.0 


A. D. 

5.3 

5.0 

5.8 

5.4 

5.4 

5.7 

5.4 

5.9 

6.3 

7.4 

5.1 

9.3 


Cases 

41 1 

82 

82 

63 

89 

66 

62 

44 

55 

43 

29 

89 

Female 

Aver. 

10.9, 

16.0 

19.9 

19.623.1 

125.627.4 

29.7 

29.1 

32.033.1 

31.3 


A. D. 

5.3 

5.2 

! 6.4 

6.3 

i 

6.4 

6.1 

6.7 

5.3 

6.3 

4.4 

5.4 


applying for working certificates.® From data kindly supplied 
me by Mrs. Woolley I have constructed also the percentile 
curves, Figs. 67 and 68, for the same groups of children. 

(2) Dependence on age, Pyle’s averages, with two excep- 
tions, show-, that the capacity in the substitution test improves 
every year from 8 to 18, both in boys and in girls. The Cin- 
cinnati children at 15 surpass their 14-year-old records, with 
every page and in both speed and accuracy : the difference is too 
Ijronounced to be due to the I’epetition of the test, since differ- 
ent keys were employed in the two trials. 

(3) Dependence on sex, Pyle's averages show that the girls 
make more correct substitutions than the boys at every age 
from 8 to 18, with a single exception (age 18, digit-symbol test) . 
In the three test sheets the Cincinnati girls are slightly superior 
to boys in index, while the sex differences in accuracy are too 
small and inconsistent to be significant, so that speed is the 
important factor in the better index of the girls. With the 
4th (memory) sheet, there is no difference in index at 14, but 
the girls are superior at 15, Girls at 15 also slightly surpass 
boys in accuracy on the 4th sheet. 

(4) Dependence on race, B. T. Baldwin tested 37 \viiite and 
30 negro girls at a Pennsylvania Reform School for IG prac' 
tise days, 5 min. per day, after eliminating 3 whites and 14 
negroes who failed to attain 50 per cent, accuracy. Table 86 

‘Consult WooUoy ainl Fis<iior for table sbowiuf: norms of amirary aiul 
for numerous graphs of Oistribiition for the substitution intlex in rela- 
tion to school grade.. 
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TABLE 85 

Substitution Index, in Sec., Cincinnati WorJcing Children (Woolley and 

Fischer). 


AGE 1 

BANK 

SHEET 1 

SHEET 2 

SHEET 3 

SHEET 4 

Boys^ 

j Girls 

Boys 

! Girls j 

Boys 

Girls 

Boys 

Girls 



! 

[Best 

71.0 

83.3 

68.5 

68.0 

59.4 

59.8 

53.0 

52.3 



75th Perc 

147.0 

142.0 

115.7 

108.7 

1 97.4 

94.0 

89.6 

88.5 

14 


50th Perc 

172.7 

1 162.6, 133.2 

! 130.4 

115.9 

112.7 

111.2 

112.6 



25th Perc 

200.9 

185.6 

157.6 

154.0 

138.4 

134.8 

148.3 

150.5 



Worst 

400.0; 

419.5 

378.0 

298.4 

276.4 

242.9 

1,257.6 

I 

525.4^ 



[Best 

82.2 

98.4 

55.0 

67.4 

54.0 

59.2 

i 52.6 

50.6 



75th Perc 

137.3 

130.4 

104.6 

103.6 

92.0 

91.9 

84.4 

85.3 

15 


50th Perc 

157.3 

148.6 

123.7 

119.0 

110.7 

108.7 

104.9 

103.9 



25th Perc 

179.0 

171.6 

145.7 

138.1 

133.4 

128.7 

145.7 

139.3 



Worst 

286.6 

307.8 

241.3 

295.1 

355.5 

248.6 

906.5 

19,875.0 


•To which should be added one ease of complete failure — accuracy only 
6 per cent, and index GC»,000. In comparing this table with the original 
text it should be noted that I have reversed the designations of the per- 
centiles, so that ICO per cent.' here would represent the quickest perform- 
ance (smallest index). 


shows clearly the superiority of the whites. In general, the 
negroes make only 62.4 per cent, as many substitutions and 
245.3 per cent, as many errors as the whites. The fact that the 


TABLE 80 

Average Number of Substitutions Made by S7 White and 30 Negro Girls 
in a Fennsylvania Reformatory (Baldwin) 


TEIAL 

1 

2 

3 

4 

5 1 

6 

7 

8 

9 

Whites ^ 

23.8 

42.6 

46,7 

54.2 

61.7 

1 64.9 

I 67.8 : 

78.3 

79.6 

Negroes 

22.6 

27.6 

31.2 

35.8 

J 

46.9 

48.0 

53.9 

57.7 

61.5 


TEIAL 

10 

11 

12 

13 

14 j 

16 

16 

AVBB. 

Whites 

86.9 

85.9 

89.5 

94.1 

93.7 

100.1 

116.5 

72.3 

Negroes 

64.7 

76.6 

71.6 

76.0 

78.1 

72.3 1 

I 

89.0 

55.8 
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average age of the whites is somewhat gi*eater (16.7 vs. 15.1 
years) by no means accounts for these differences. Baldwin 
notes that there are also distinct qualitative differences in the 
work of the two races : negro girls are slower to warm up to the 
task, and first to drop back and lose interest : they cannot be 
forced or stimulated easily, except temporarily through flat- 
tery: their work is more irregular, more subject to moods, less 
accurate and less neat. ^‘They are partially occupied with the 
task in hand and partially with a random activity, which con- 
sists in mumbling, grumbling, humming or saying original and 
funny things. This second attitude seems a common trait with 
the race unless consciously inhibited.” ^ 

. (5) Dependence on practise, (a) Practise-effects within the 
single trial of the substitution test are revealed, of course, by 
comparison of the rate and accuracy of the work in the different 
sections or sheets into which the material is divided. With 
Form A or Form B the increase in speed in the 8th as over 
the 1st section amounts to some 10 to 20 per cent. This im- 
provement is not acquired uniformly, however, from section to 
section. On the contrary, as Tables 81 and 82 show, there is 
a tendency toward a decrease of efficiency at about the middle 
of the work. Thus, in the individual tests both men and 
women, taken collectively, show a reduction of speed in the 5th 
section: similarly, in the group tests both men and women 
write fewer symbols in the 5th than in the 4th 30-sec. period. 


In the individual tests, tlve 4th section comes at tlie bottom of the first 
column, tlie 5th at the top of the second column. The brief delay occa- 
sioned by the necessary readjustment (of paper, pencil, attention, etc.) 
may explain a part, but only a part of the reduction in time. 

A plausible explanation is that reported by one S, who noted that, in 
Section 4, being so far from the circles, she rt^Iied upon her memory, 
whereas in Section 5, the very proximity of the circles tempted her to 
glance at them to make sure of her work, and thus to work more slowly.^ 

^Since the above was written, Pyle (Oa) has published the results of 
an investigation in the public schools of Missouri which discloses a 
similar inferiority of negroes to whites In the substitution test. Speak- 
ing in general terms, the negroes are less than half as efficient .as the 
whites in the test. 

*Forni A has been devised especially to avoid the variation in distance 
of test-blanks from the pattern at different periods of the work. 
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To test this liypothesis, triiils were made with 10 college students, using 
material of Form B, but rearranged (us suggested above) to resemble 
Form A (the test-hlank In one long column sliding beneath the cardboard). 
The average scores, in sec., per 5-line section, were 55.7, 48.G, 44.0, 40.9, 
.40.3, 41.5, and 40.8, for the Sections 1 to 8, respectively. (Total time, 
354.8 sec.; symbol score, 8.2). There is, then, still a loss of more than 2 
sec. at Section 5. 

It would appear,' therefore, either that the lest-material of Section 5 
happens to be more ditticult than that of Sections 4 and G, or that, as a 
final possibility, the slower rate in Section 5 is nr ely an expression of a 
mental condition — fatigue, weariness, lo.ss of initial enthusiasm. That 
tills explanation may he entertained is shown in Table 87, where it will be 
seen that, although more S'h lose .sjioed in-tlio Sth than in any other sec- 
tion. there are, nevertlieloss, numerous insianees of los.s of speed in other 
portions of the work, especially in Section 7. The of Table 87 are the 
10 jnst mentioned, and the IS of Table 82. 


TABLE 87 

fiubatitution Tent. Distribution of Gains and Losses in S^pcvd (lV7i//)p/c) 


SECTIONS 

1-2 

I 2-3 

1 

4-5 

5-6 

€-7 

7-8 

Number gaining speed 

24 

17 

16 i 

9 

19 

12 

16 

Number losing .speed 

4 

7 

' 8 

16 

8 

15 

8 

Number maintaining speed 

0 

I 

4 

4 

3 

1 

1 

4 


(h) Special investigations upon practise in this test have 
been made by Starch, Lough, Kline and Miss Munn. Starch’s 
work, which is confirmed by Miss ^luiiii’s, shows that relatively 
short, distributed practise periods are the most etfeetive (Fig. 
GO) ; from 10 to 20 min. seems to be best, at least for adults, 
lyough found no evidence of plateaus in the curve of improve- 
ment in tests lasting from 20 to 00 days. Miss Munn found the 
typical curve of improvement to be rapid in rise at first, then 
slower. Children were slower at the start, but gained more, 
absolutely, than did adults. Curves from two aged jS^’s were 
similar to those obtained from the young. Retrials showed 
that fairly strong practise-effects persisted for at least as long 
as 5 mos. 

Kline tested the effect of practise in one form of substitution 
upon performance in other forms of substitution and found that 
^'practise in writing digits for letters is transferred with favor- 
able effect to subsequent work in writing symbols for digits, 
but is transferred with unfavorable etfect to subsequent work 
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no. 08. PEBCENTILES FOR THE SUBSTITUnON INDEX FOR CINCINNATI WORK' 
INO CHILDREN 14 AND 15 TEARS OLD — SHEET 4 (After 
Woolley and Fischer) 
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FKI. CO. T OF rUACTIKE TERIOOS OF DIFFERENT EENOTIIS UPON PEBl'ORM- 

ANOE IN THE SUBSTITUTION TEST (From Starch) 

Results based on tlie work of 42 collej^e students. Units on tbe b«ase- 
line represent innnber of successive 5-niin. periods: ordinates represent 
number of substitutions made in 5 niln. Designations attached to each 
curve indicate tbe lengtli of tbe work periods of each group. 

in writing digits for symbols,’^ Moreover, the more the drill 
work is spread out in time, the greater, on the whole, is this 
interference effect. Here the interference is due, of course, to 
the fact that in the second test-series the same characters must 
be written as in the drill series, but with different associative 
connections. 

(C) Dependence on hitelUgence. If we admit that the school 
grade reached by children 14 or 15 years old affords a good in- 
dication of their general intelligence, it follow^s that the sub- 
stitution test correlates well with general intelligence, since 
there was found at Cincinnati a “positive correlation with 
school grade for all four pages of the test, for both sexes, and 
at both ages” (15, p. 153). This correlation is less evident with 
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the 4th (memory) sheet, where individual differences are most 
manifest. It follows that children who have reached higher 
school grades exhibit a somewhat higher performance in the 
memory test after having spent a decidedly shorter time in the 
process of learning. The above results pertain to the substi- 
tution index (Form C) : as to accuracy, that is also positively 
correlated with school grade, though not so markedly nor so 
consistently as the index. Similarly, Woolley and Fischer 
report that some of the jS’s sent to them under suspicion of 
mental deficiency were able to attain fair success with the 4tli 
sheet, but /^required a far longer time, often more than twice 
the time, to reach the result” (p. 244). 

The author has compared 6 dull and 5 bright grammar-school 
boys and obtained the results shown in Table 88. Since, with 
a single exception, all the dull boys are older than the bright 
boys — on the average about 3 years older — the actual difference 
in capacity between the two groups that is ascribable to intelli- 
gence is much greater than appears from the averages obtained. 


TABLE 88 

Substitution Test. Bright and Dull Boys, Form B. Individual Method 

{Whipple) 



BOY 

AGE 

SCHOOL 

GRADE 

1 TIME IN SEC. 

SYMBOL 

1 SCORE 

\ 

H. 

16:9 

7, 

ir 

700 

6 


K. 

13:1 

5. 


742 

8 

Dull 

N. 

14:9 

6, 

1 

! 422 

9 

Group 

M. 

12:8 

6. 

I 

975 

1 


B. 

12:6 

7. 

II 

707 

4 


S. 

15:2 

6. 

I 

660 

9 

Average 


14:2 


1 

701 

6.17 


Br. 

11:11 

I 

8, 

I 

677 1 

9 


Hu. 

! 12:8 

6. 

TI 

697 

5 

Bright 

Id. 

10:9 

6, 

II 

566 

9 

Group 

1 

Tr. 

1 10:4 

6, 

TI 

i 648 

1 4 

Fe. 

1 10:8 

6. 

II 

591 

9 

Average 


11:1 


615:8 

7.2 
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(7) Dependence on physical condition. Miss Kolinky used 
the Cincinnati substitution test among other tests with pupils 
of two 5th grade classes in that city in her study of the effects 
of dental treatment upon physical and mental efficiency. The 
test was given in October to pupils in Room 18 and Room 21, 
two comparable groups. The pupils in Room 21 were then 
given elaborate dental treatment, those in Room 18 were 
given none. Both groups were retested in the following May. 
The score for the untreated rooni was 201.6 for the 1st sheet in 
October and 110.5 for the 4th sheet in May, a total gain of 
01.1 : the score for the treated room was 206.6 for the 1st sheet 
in October and 104.9 for the 4th sheet in May, a gain of 101.6, 
from which it is argued that the pupils subject to dental treat- 
ment developed greater ‘learning power.’ 

(8) Delinquents, Miss Weidensall tested 88 Bedford Re- 
formatory women and also a group of Vassar College dormitory 
maids with the material of Form O. Bhe found that the various 
reformatory groups differed more from one another in speed 
than in accuracy, that both the college maids and the reforma- 
tory women differed from the Cincinnati working girls more 
widely on Sheet 1 and Sheet 4 than on Sheets 2 and 3, from 
which it may be inferred that the working girls make a quicker 
adjustment to the task and reach a higher accomplishment in 
distinctly less time. The work with the first and fourth pages 
divided the reformatory women into two distinct groups which 
correspond with, and confirm the schoors estimate of their 
intelligence : thus, when the women are divided into two groups, 
65 per cent, of the below-grade (schooling less than Grade 5B) 
are as poor in index of substitution for Sheet 4 as the poorest 
quarter of the grade group. Again, when the women are divided 
into smaller groups on the basis of years of schooling, there ap- 
I»ear8 a positive correlation with amount of schooling that is 
as close as that found at Cincinnati. Reformatory women that 
had reached the 8th grade in schools were better than 15-year- 
old Cincinnati working girls in both accuracy and time on Sheet 
4, but elsewhere the reformatory women were quite generally 
inferior to the working girls, and the inferiority becomes in- 
creasingly great as the grade at which the reformatory women 
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left school becomes lowe^ A general idea of the inferioritj 
is given bj Table 89. Finally, the correspondence between the 
results of the test and general ability is further indicated by 
a correlation of 0.48, P.E. .06, between rank on Sheet 4 and 
native ability as estimated by the principal of the Reformatory 
Industrial School. 

TABLE 89 


Differences, in Sec,, Index of Suhstitution, Form C, between Bedford Hilts 
Reformatory Women and Cincinnati Working Outs Vf 
and 15 Years Old (After Weidensall) 


! 

i 

SHEET 1 ! 

i 

SHEET 4 

1 

1 

PERCENTILE | 

25th 

60th 

1 

75th 

25th 

i 

Both 

7Bth 

14 Years 

-59.4 

-10.5 

i +6.0 

-184.5 

-44.9 

- 8.1 

15 Years j 

-73.4 J 

-24.5 , 

1 

1 

-195.7 

-53.6 1 

i 

-lU 


Plus sign huiicates that the Bedford group is faster, minus sign slower 
than the Cincinnati group with which it is compared. The order of per* 
L-eiitiles is here reversed from that used in the original tables: here the 
75th Is better than the 50th percentile. 

Note. — S^ s who make the fastest records commonly employ 
the scheme of holding in mind the entire 5-place number (in 
Form'B), and writing down the symbols while keeping the eyes 
directed upon the circles. The material in Form A lends itself 
less easily to this scheme. 
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especially 148-1S4. 


TEST 38 

Memory for serial impressions: ‘Rote’ memory.’ — The essen 
lial idea in the several forms of memory test treated under this 
title is to present a series of discrete impressions (c. letters, 
digits, words), which is, if possible, to be reproduced in correct 
order and exactly as presented. These tests are to be con- 
trasted with the so-called tests of iogicaT memory, in which the. 
material presented is a logically connected whole, and in which 
the requirement is to reproduce the substance, or the meaning, 
of what has been presented. In either test, the reproduction 
may be immediate or delayed, and the mode of presentation 
and method of measuring efficiency may be varied in many ways. 

Memory for a series of discrete impressions has been ^ised to 
study individual differences, as conditioned by sex, age, mental 
ability; to detect fatigue; to investigate the nature of practise, 
ihe possibility of training retention and recall, the most eco- 
nomical methods of learning, etc. 

To understand the results and conclusions of the small army 
of investigators of memory, it is convenient to classify the 
methods and the materials that have been most commonly 
used.* 

^The authof desires to acknowledge the assistance of Dr. L. R. Geissler 
In the collatlf n and sifting of the literature bearing upon thl? test 

more extend^ discussion of the historical development of” the sev- 
eral experimental methods, togetlier with aeconnts of the results that have 
been attained, the reader should consult Bentley, Binet (9), Burnham, 
Ebbinghaus, Gamble, Henri, Offner and Pohlmann. The last-named gives 
a particularly valuable summary of the methods. 
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CLASSIFICATION OF METHODS FOR MEMORY TESTS 

(1) The method of complete memorization, or method of complete mas- 
tery {Ev'lernnnQBmethode) , developed in the classic work of Ebblnghaus 
{JJeher das Geduchtnis) in 1885, and refined by Mtiller and Schumann, 
demands that 8 repeat the series of impressions again and again until he 
can reproduce it without error, without hesitation, and with certainty of 
correctness. Efficiency is measured by the number of presentations re- 
quired for this complete learning. 

In practise, this method is frequently supplemented by testing the 
number of presentations of the same series that is needed to relearn it at 
any assigned time after the first learning (Ersparnisverfahren or Erspar- 
nismefhode), in which case the saving in number of repetitions. In the re- 
learning, as compared with the learning, measures the amount of reten- 
tion, or the degree to which the first impression has persisted. 

(2) The memory-span method (Methode der Oeddchtnis-Spanue), 
first devised by Jacobs, elaborated by Ebert and Meumann, and extensively 
used In England and America, consists in the determination of the maxl- 
lual length of a series of impressions that can be reproduced with a given 
degree of accuracy (usually complete accuracy) after a given number of 
presentations (usually, though not necessarily, one presentation). Ordi- 
narily, E begins with a series that is easily within 8's limit, and increases 
the length of the series, keeping other factors constant, until errors 
appear. 

(3) The method of retained members {Methode der hehOUenen 
Olieder), first so designated by Ebbinghaus, but more carefully studied 
by Pohlmnnn, consists in the determination of the degree of mastery (pro- 
portion of elements correctly reproduced) of a series of a given length, 
after a given number of repetitions. The method is somewhat like the 
span method, but the length of the series is so chosen that 8 cannot attain 
complete mastery. In practise, many span tests actually become tests of 
degree of mastery. 

(4) The method of right associates (Treffcrmethode) , proposed by 
Jost and developed by Mtiller and Pilzecker, consists in presenting a 
series of impressions (typically, nonsense syllables in trochaic rhythm), 
and of subsequently testing 8*s ability to name the member that follows 
anyygiven member. Usually flie accented member is given, and 6 tries to 
designate the ‘right associate’ for it. (When his time of response is meas- 
ured, the method is known, in full, as the Treffer- und Zeitrnethode) , Its 
6r»ecial value Is to afford opportunity for analyzing the nature of the asso- 
ciative connections ; it has not been proposed as-a test of efficiency. 

(6) The method of prompting {Methode der Hilfen), somewhat simi- 
larly, tests the nature and strength of the Individual associative counec- 
tl<Rip in^the series, and is of questionable usefulness for practical testing. 
As illustrated in the work of Epbrussi, the method consists in an attempt 
by to reproduce the series before it has been fully learned, and in 
promptings by E at each point of hesitation or error. Efficiency is in- 
versely related to the number of promptings required. 

(6) The method of interference of associations is exemplified In Berg- 
strom’s study of card-sorting (5). Here 80 cards are sorted by E into 10 
piles, and subsequently, at a given interval, into another 10 piles differ- 
ently arranged. The second sorting is slower because Of the persistence 
of associative connections developed in the first trial. Analogous tests can 
be fashioned with other forms of material, as has been suggested in the 
SubstHution Test. 
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(7) The method of reconstruction, used by MUnsterberg and Bigbam 
with colors, and by Miss Gamble with odors, consists in presenting a 
series of stimuli in a definite order, and then, after a predetermined in- 
terval, in presenting the same stimuli in chance order. 8 attempts to re- 
arrange them in the original order. 

(8) The method of recognition consists in the presentation of a lim- 
ited number 0£ impressions, which are subsequently presented again, in 
conjunction with other stimuli, to see how many of the first series A? can 
recognize in the second series. Examples will be found in the work of 
Smith and of Henri. 

(9) The method of idenlicat series, as employed by Beuther is a modi- 
fication of the method of recognition, in which the original series is always 
actually presented intact, though, of course, this fact is concealed from 8. 

(10) The method of continuous lists {Methode des fortlaufendcn 
Xieder^cUreihens Oder Aufzdhlens), employed by Krscpelin, is Identical 
with the procedure described in Test 33, though sometimes 8 is required 
to write words that belong to specified categories. 

(11) The method of chance verbal reactions {Methode der zufdUigcn 
Wortreactionen), well illustrated by the investigations of Aschaffenburg 
and G. E. Mtiller, Is the stock association experiment, with emphasis upon 
the qualitative as well as the quantitative study of the associative se- 
quences. ( See Test 33A. ) 

(12) The method of description or report {Aussage) is a form of 
memory investigation Avith peculiar problems of its own, as has been 
shown in Test 32. In it, the terms in which the reproduction takes place 
are not restricted to a direct equivalence with the material presented, but 
are merely Indicative or descriidlve of this material. 

The tests which follow are primarily intended to test capacity 
for immediate reproduction after a single presentation, either 
by the memory-span method or by the method of retained mem- 
bers (degree of mastery). The capacity which is tested corre- 
sponds to what the Germans call Merkfdhigkeit — a term which 
is perhaps best rendered in English as immediate memory. 
Tests of capacity to recall or to recognize after an interval 
of greater or less duration would doubtless more nearly meas- 
ure memory in the more exact sense of that term, but, unfortu- 
nately, little attention has been paid to this phase of mental 
testing, owing presumably to the desire to complete observa- 
tions in a single sitting. 


CLASSIFICATION QF MATERIAL FOR MEMORY TESTS 


The materia] used in tests of serial memory may be classed 
according to the sense-department to which it is presented 
(visual, auditory^ visuabaoditoryi etc.)^ and according to its 
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nature or form. Again, visual material of different forms may 
be presented either simultaneously or successively. 

( 1 ) A^tval objceu wore used by Netscbajefif, Lobsien and Kirkpatrick. 
Thus, Lx>i>sieD showed 9 objects at the rate of 1 per sec., e. g.t newspaper, 
key, liandkerchief. glass, slate, box. book, glove, chalk. Netschajeff used 
12. Kirkpatrick 10 objects. 

(2 1 PicturcH of objects, 10 in number, w'ere used by Miss Calkins; 
groups of 20 pictures by Mrs. Squire and by Carpenter, following the sug- 
gestion of the earlier Binet-Simon tests. 

(3) f^entcnces also form a portion of the Binet-Simon tests, and have 
been tried by Ritter, Miss Sharp, Mrs. Squire, Carpenter and Abels^m. 
Directions for their use will be found below. 

<4) W ords may be used in the most varied kinds of series. Thus, 
series of l.iat in-German, or English-German, or other pairs of nouns, have 
been used to produce a ‘vocabulary* form of test, as by Wessely. A dis- 
tinction may be made between ‘related* or ‘assoclable’ terms and ‘unre- 
lated’ or ‘dissociable’ terms (Norsworthy : Bergstrom, C>). For example, 
paper, u riting, compose, etc., vs. horse, bricks, soldier, acorns, etc. Men* 
iiiann (51). Burt (IC) and Pyle have compared the span (3 to 8-term 
series) for concrete nouns, c. g., stove, ink, lamp, street, etc., with the 
span for abstract iiouus, c. g., influence, etc. Netschajeff and Ijobsien 
tested the relative reproducibility of words (12 and 9-term series) that 
connoted visual, auditory, tactual and emotional ideas, respectively. (Ex- 
amples: lightning, dial, sunbeam; thunder, crash, tchisflc; cold, soft, 
smooth : hope, doubt, regret.) Kirkpatrick and Calkins also used 10-torm 
series of words that related to objects, as did Pohluianu. Hawkins com- 
pared simultaneous and successive exposure of 15 nouns. Bluet, Ritter. 
Simpson. Abelskm, Lapie and Sharp also employed lists of words of varied 
length and complexity. 

(5) Nonsense syllables were tried but discarded by Jacobs, likewise 
by CJoho and Dieffenbacher. They formed, however, the stock materia) 
In Ebbiiigbaus’ pioneer work, and were subsequently made more service- 
able by the precise rules that MUller ami Schumann formulated for their 
construction. Bergstrom, Burt, Smith, MUller and Pilzcnker. Pohlinana. 
van Biervliet, and others have found them of value. Indeed, l^hlm.mn 
contends that, on accotuit of their equivalence one to another and their 
relative freedom from varying associations in different N's, nonsense sylla 
bles form the best and most reliable material for memory tests Series 
specially adapted for English readers will be found in Test 25. 

(9) Letters (usually consonants only, to avoid the formation of 83 lla 
hies or words) have been used by Jacobs, Binet (8), Cohu. Pohlmar.n 
Sharp, I' inzi. Smith (71, 73), and Winch (80). An idea of the great 
variety of procedure that may \w developed with a single form of material 
ntay be gahied b 3 ^ noting that Binet used 15 consonants e.vposed visnally 
and ftimultaneousl.v, for 20 .sec.; Cohn exposed 12 consonants arranged In 
the form of a square for 25 sec.; Pohlmann read 10 consonants to his 8 s 
3 times ov(‘r; Sharp exposed 12 letters .successively with the Jasiruw 
drop-apparaius, at the rate of 1 per sec., and repeated until the series w as 
learn^ ; Smith expose<i 12 consonants simultaneously for 10 sec . and read 
other series of 4, 5. 9, 7. and 9-term consonants ; Wiru-h repeated 12 <x>nso 
nants auditorily in 25 sec., and also used the letter square method (ilc 
scribed below), as did W.vatt and Anderson. 
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(7) Two-place numbers, administered orally, were used by Sctiuyten 
(8 numbers repeated by N’s in coneert), Lobsien (9 numbers), Pohlmaun 
(10 numbers given three times), and Netschajeff (12 numbers). 

(8) Digits,^ i. €., one-place numbers, have been employed by Jacob-^, 
Johnson, Bolton, Panet, Ebbingliaus, Hawkins, Ritter, Chambers, Kohnky, 
Laple, Sharp, Smcdley, Krueger and Spearman, Wissler, and many others, 
in the most varied manner (4 to 10-place series, given auditorily, visually 
— either simultaneously or successively — or in combined api)eai to vision 
and audition, vision, audition and ‘hand’ memory, or to vision, audition, 
and ‘articulatory’ memory). Abelson appears to be the only investigator 
to have discarded digits as inappropriate for mental tests. 

(9) Gcmncirica] drav'wqs have been used by Miinstei'berg and Big- 
ham, and by Bernstein and Bogdanoff, who selected forms that would be 
unfamiliar to their 

(10) lAnes of varied lengths have been employed by Toulouse and by 
Binet (9). 

(11) Mist cl lU)) eons visual {haraclcrs, symbols, combinations of dots, 
lines, etc., formed a i)ortion of the material in the investigation of Ehert 
and Meumann. 

(12) Sounds, such as those prodiK'ed by tearhig paper, whistling, 
stamping, ringing a hell, elc., w(‘ie arranged in 9-element series by ]-.ob- 
sien, and in 12-elenient series by Netsehajoff. 

(18) ^Ivmoiy for connnissiffus forms a well-known part of the Binet- 
Simon tests. An extension of this Idea into a sort of memory-span test 
of memory for commissions has been used by Abelson in the stialy of back- 
ward children. 

Aside from these wide differences in general method and in form of ma- 
terial, attention should he called to differences in rate or tempo at which 
the series is first presented, to differences in the number of times the series 
is presented, and to differences in the time-interval elapsing between 
presentation and rei)roduction. 

As a rule, the rate of tn-eseutation has been not slower than 1 impres- 
sion in 2 see., and not faster than 2 impressions in 1 sec. A rate ot 1 Im- 
pression in 0.75 sec. has been found well adapted for adults. 

The typical si)an test is one in which tlio series is presented but onoe: 
from the point of view of functional testing, therefore, tlie rei>etition of 
the sthmilus series may he regarded as a variant method, not to be intro- 
duced *save for the special purpose of studying its effect. 

Similarly, as lias already been said, the greater portion of the tests here 
reported have been made with no interval between presentation and repro- 
duction. It is to be noted, however, that Smedley, in his tests of Chicago 
school children, separated presentation and reiirodnetion by an interval 
of 5 sec. Wyatt eauseil his iS’s to count backward from ‘20 before writing 


'Reutber has formulated rules for the constrnotiou of test-series of 
digits, analogous to (he rules of Miiller and l>(huniann for test-sories of 
nonsense syllables. The following are the most important of Reiither’s 
prluolplos- (f ) Do not repeat a digit in the same series (fmpossible to 
avoid, of course, In 10-place series). (2) Do not begin a series with the 
numbcf I. (8) AvoI«l the use of 7ero. (4) Do not place any two digits 
In theil* natural relations with one another. (5) Do not use se(piences 
that st^gest historical dates. (f>) Do not use in immediate succession 
t>vo sfVies that have the same digit in the same place .at any point in the 
bcries. 
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nonsense syllables and introduml an inte)*val of 5 sec. in his tests with 
letter-squares. Kirkpatrick, and Calkins in her repetition of his tests, 
secured a reproduction both Iniinediately after, and 3 days after the pre- 
sentation, in order to contrast ‘immediate’ with ‘delayed’ memory or recall. 
Somewhat s'lmilarly, Binet. and Sharp in her repetition of his tests, se- 
cured a reproduction of each of seven T-r-lace word-lists directly after its 
presentation, and a ‘recapitulation,’ i:: so far as it was possible, of the 49 
terms at the close of the whole test. i. e., about 3 min. after the first presen- 
tation. Binet (‘ontrasls. in this way, immediate memory with what he 
terms ‘memory of conservation:’’ 

Since, as tlie resrdts tliat follow show, oven minor variations in the con- 
duct of a memory test afiect its outcome, it follows that the results of dif- 
ferent investigators may imt he oxpecte<l to exidhit complete accordance 
with resjjecl to the relative infiu^nce of sox, age, mental ability, etc. 

Five elnef foiiuB of lest been selected and are recom- 
inended pc? standard for this field of investigation; variant 
methods are sriggested in each ease. Fj reference to the edassi- 
fieatioa of methods and materials just given, E can devise fur- 
ther iiiorliilcations to suit special requirements. These five 
forms are (1) tests with digits, resembling in scope Smed- 
iej’s Cliicagii (csis, but with several differences in procedure, 
(2) tests with letters, after Cohn's method, (3) tests with lists 
of words, afler the methods of Meumann and of Burt, (4) tests 
with serslenccs of graded difficulty, and (5) tests with pictures 
of objects. 

A. XI EMORY SPAN FOR DIGITS 

Materials. — Print od test-cards, 42 in number, arranged in 
three sets of 14 cards each, for presentation by 3 different 
methods. (Each set contains 2 cards each of 4, 5, 6, 7, 8, 9, 
and 10 digits.) Metronome. [For serial visual exposure, in 
addition, Jastrow’s mcmiory apparatus (Fig. 70). Cardboard. 
Willson's giimnied figures, black, Size 5. For letter tests, full 
sets of gummed letters, Sizes 5 and 10.] 

Prelixiinaries. — On the ba<‘k of each card wu*ite the digits 
that are printed on its face: this enables E^ when the test de- 
mands it, to pronounce the test numbers while displaying the 
card to 8, The purely auditory and the auditory-visual-hand- 
motor series are not included in the printed cards, but should 
be prepared by Z7, preferably, for convenience, on a single piece 
of cardboard, the size of the printed cards. For the auditory 
series, use the following numbers, in the order given: 0135, 



156 [522] ASSOCIATION^ LBARNING AND MEMORY 

2947, 36814, 57296, 241637, 935816, 8537142, 9412837, 47293815, 
71836245, 924738015, 475296318, 8697132504, 2146073859. For 
the visual auditory-hand-motor series, use these numbers, re- 
versed, e. 5316, etc. 

IMethod. — If only a single test can be made, employ the 
visual-auditory articulatoiy form of presentation, since this is 
most likely to produce uniform conditions of ideational imagery 
for all But if the tests can be taken in full, follow the 
order of presentation outlined herewith.'^ In any event, preface 
each form of presentation with a special, short sample-series, 
without demanding reproduction, in order that S' may be per- 
fectly clear as to the nature of the test. Within each form of 
test, also, preface each presentation with a statement of the 
number of members in the coming series, e. g.: ‘‘This will be a 
series of 5 digits.^^ The metronome should be set at 60, i e. 
one stroke per sec., for all tests.'^ 

(1) Auditory presentation. Explain the test by a simple 
illustrative series. Require *8 to close his lips firmly, and to 
press his tongue against the roof of his mouth — this to reduce 
the tendency to articulation, and in group tests (all of the 
memory tests lend themselves well to group presentation) to 
avert communication between >8^s. Start the metronome.® Pro- 
nounce the digits, one at a time, with the utmost care to ensure 

^It goes without explanation that the longer series may be omitted with 
very young, the shorter with mature S’s. Use, for the shortest series, one 
that is easily within the span of the poorest -S to be tested, for the longest 
series, one that is too clitticult for the best S to reproduce without error. 

®It may be well at this place to point out the differences between this 
procedure and that followed by SinMley at Chicago. Smedley used no 
series longer than 8. He gave no warning of the length of the coming 
series. He set the metronome at 00, He did not present the several series 
in regular order, but irregularly, though beginning with an easy series. 
He inserted an interval of 5 sec. between presentation and reproduction. 
He distributed his tests, seven in all, at hourly intervals. Fiftally, he 
gives no clear statement of his method of computing results, save that 
the ‘‘percentage correctly recorded constituted the grade.” 

®If he finds it necessary, E may substitute a silent metronome, made by 
swinging a small weight on a string, but the, fact that the regular metro- 
nome is .somewhat noisy should not be taken as evidence that it disturbs 
S: on the contrary, a noise of moderate intensity is not infrequently 
found to be a stimulus to better attention. Moreover, the ticking metro- 
nome Is much more serviceable when is asked to pronounce the digits 
In conjunction with E, and it probably operates to some extent to break 
tip tendencies to learn the digits by grouping. 
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even tempo, clear^articulation, and entire absence of rhythm.* 
Directly at the conclusion of the series, let 8" repeat as much 
as possible of it. Although, under some circumstances (with 
very young or backward ^’s), an oral reproduction may be im- 
perative, a written reproduction should be considered stand- 
ard, both because the proper placing of the digits furnishes E 
with data for scoring ;S’’s ijerformance (;.ud the placing must 
indicate possible omissions), and because experiment shows 
that, at least for maturer ^’s, written reproduction is pre- 
ferred, and is more successful than oral reproduction. /S^’s re- 
call should, therefore, be entered upon a prepared blank, with 
the caution to indicate every omission by a dash or a blank 
space.® 

(2) Visual presentation. Use Cards V-4a, V-4b, etc., to 
V-lOb. Follow the directions for auditory presentation, but 
in place of pronunciation, exhibit the entire card for a length 
of time identical wdth that for auditory presentation, i. e,, with 
an allowance of 1 sec. per digit. The metronome should be 
used here, as in all phases of this test, in order to keep the con- 
ditions of presentation comparable. It probably also tends to 
induce *Sf’s to apprehend the digits successively and in the same 
teiilpo as that used for auditory presentation. Note to what 
extent articulates the digits: even with lips and tongue 
placed as directed, they will often be seen to move, and con- 
tractions of throat muscles may also indicate partial articu 
lation. 


• 

"The dilliculty of speaking without accent, or without grouping the 
digits, has led ninet to reject oral, in favor of visual pi esentation. Even 
if E pronounces withont accent or rhythm, there is no guarantee that s' 
may not mentally cast the digits into a strongly accented and grouped 
series, and, in fact, mature working with the longer series, are almost 
certain to catch this ‘trick’ in time. Hitter advocates that E should give 
a decided objective rhythm to every series on just this account ; this factor 
will then form a coustant, rather than a variable ‘error.’ Oue diihculty 
with this plan lies in the fact that, in using series of varying lengths, it 
is impossible to use any constant metrical phrasing. 

®For group work, the class should be provided with blank forms, so 
nujubered and arranged that no misunderstandings may occur on the part 
of iS In entering the data, or on the part of E in interpreting it. Allow 
ample time for writing. Netschajefif, Pohlmann and Schuyten all found 2 
min. desirable in classroom tests. In group tests, care must be taken to 
prevent audible repetition of the digits during the reproduction. 
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(3) Auditory visual presentation, presents the cards, as in 
the purely visual procedure, but also pronounces the digits, 
as in the auditory procedure, by reading them from the back 
of the card. /S' sees and hears the digits. Cards AV4a to 
AV-lOb are used. 

(4) Audilory visual-artieulatory presentation, E presents 
the cards as in (2). E and pronounce them in concert, in 
time with the metronome. /S' sees, hears, and pronounces the 
digits. Cards AVA-4a to AVA-lOb are used. 

(5) Auditory visual-hand-motor presentation. E pronounces 
the digits as in (1) : S writes them, as fast as pronounced by E, 
upon scrap paper: when the series is finished, >8^ at once discards 
tjie scrap pajier, and reproduces the series. E hears, sees, and 
writes the digits. Use the same numbers as in (1), but reverse 
the order of the digits. Jn this test, it will ordinarily be neces- 
sary to devote one or two preliminary trials to fore-exercise. 

Variations of Method. — (1) Meet the bothersome tendency 
toward grouping and rhythmisieg — bothersome because ex- 
liibited by some /5?^s and not by others — by presenting the digits 
in trochaic rhythm : this device is perhaj^s favored by selecting 
s(*ries of 4, G, 8, and 10 digits only. 

(2) Introduce a time-interval between presentation and re 
production. If this interval is v^^hort, it may with advantage 
be occui)ied with some form /of distraction, like saying the 
alphabet in concert, since the efiect will be more like that of 
a much longer ^empty’ interval. The disadvantage of an un- 
occupied interval is that some aS's will mentally jehearse the 
series just jiresented. 

(3) Substitute successive for simultaneous visual presenta- 
tion in Forms 2, 3, and 4. For this purpose, E must prepare 
cards for insertion in the Jastrow memory apparatus,^ so that 

"Jaslrow’s iiistriiinent is adequate if E is careful to make tbe exposures 
regularly, in time with the meti’onome ; it is especially useful for group 
tests. U E desires a more accurate exposure apparatus, for individual 
tests, he may employ the Ilanschburg memory-apparatus (now improved 
by Wirtb), Kubluiami’s memory-apparatus, Bergstrom’s rather elaborate 
exposure apparatus, or G. E. Muller’s modification of the kymograph for 
‘step- fash ion’ exposure, as described, in improved form, by McDougall. 
Burt, however, contends that t1ie distraction produced in immature and 
inexperienced by the sight of unfamiliar apparatus more than coiinier- 
balanees the advantage of greater precision, mechanical regulation of 
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MG 70 . J.A>STKO\V’S ML'MOUV ArPAKATUS. 

<lii* nuoiboi's usod in Forms *J, o, and 4 (above) may now be 
exposed in vertical eolunins. In order to secure sufficiently 
long series, the exposure-lever of the instrument is so inserted 


ami duration of cwposure, oto. ; lie irsed, for successive exposure, a slotted 
piece of cardboard, wliicli was shoved along the coluiim of impressions by 
E (ai»parcuily at no uiiifonu or constant rate, but as fast as proved con- 
\eineut to 8). 

Kuhlinau arranges to have each exposure followed by a blanfe section 
of [>e! haps a difterent duration from that of tbe exposure. The idea Is 
to control tlie amount of time that S can spend in re-imaging or recalling 
tile impression just received. According to Kuhliuauu, /S^’s use from one- 
half to two thirds of the total time at their command In ordinary presenta- 
tions of material for memory tests (whether simultaneous or successive) 
in this [wnress of re-iniaging. The importance of the process, he thinks, 
varic'.s much with individuals. 
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as to articulate with, the pegs that provide a drop of 1 in. at 
each exposure. Black letters % in. high (Willson’s, Size 5) 
may then be used. These are visible to the normal eye at 50 
ft., but E should take the precaution, in classroom tests, to seat 
myopic S’s near the front of the room. 

(4) Test the effect, upon a series too long for S to reproduce 
in one presentation, of two, three, or more presentations in 
immediate succession. 

(5) Give repeated tests by the same method, with a series of 
a given length (in excess of >S’s span), to test the effect of prac- 
tise. 

(6) Change the rate of exposure from one impression per 
sec. to one impression in 2 sec. 

(7) Keeping other conditions (form of presentation, length 
of series, etc.) constant, compare fif’s eflSciency under normal 
conditions with that under different forms of distraction. 
Hmith (71) used for this purpose three different concomitant 
activities: his ^’s w^ere requii*ed during the presentation (a) 
to tap in time with the beat of a metronome, (b) to repeat the 
syllable la, or (c) to add mentally by 2’8 or by 3’s. 

(8) Prepare cards with letters^® in place of digits, for use by 
any of the procedures above described. Use only consonants. 
Avoid alphabetical sequences, or suggestions of words or abbre- 
viations. 

Treatment of Data. — (1) If it is desired only to determine 
E'8 memory span, sensu stricto, this is indicated simply by the 
maximal number of digits that can be reproduced without error 
of any kind. 

(2) If, as is more usual in comparative tests, it is desired to 
determine the degree of correctness with which series longer 
than the span are reproduced, the simplest plan is to assign 
arbitrary scores to the various forms of error. Ebbinghaus, 
for example, scored every omission as 1 error, every displace- 
ment from the correct position in the series by 2 or 3 places as 
0.5 error, and every displacement by 4 or more places as 1 

"*Use Willson’s black gummed letters. Size 5, for the Jastrow appa 
ratus» or Size 10 to duplicate the regular print^ test-rards 
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error. should then be compared with respect to their error- 
score in series of each length separately. 

(3). A more scientific method of determining efficiency is that 
of computing the degree of correlation between the order of 
impressions as reproduced by 8 and their order as presented. 
This is accomplished, following the ex<unple of Krueger and 
Spearman, by ap])lying Spearman’s footrule’ formula for cor- 
relation (see Ch. Ill), though, in this connection, it is better 
to modify this formula by counting the sum of all the devia- 
tions between the two series, rather thau the sum of all the 
positive, or of all of the n<‘gative deviations. 

For treating the data of the>se memory tests, therefore, the 
formula may be written : 

R == 1 

(n”--l)/3 

The computation of needs a little explanation. Tlie following cases 
may be considered 

{(i) Sui)pose that 8 reproduces all the terms of the original series, 
but not in the correct order. The sum of the deviations is then easily 
computed. In Case A, Table 00, for instance, the sum of the deviations 
is G, and since n = 10, by tlie formula just given, li == 0.82. 

TABLE 00 


Use of the ^Footrule' Method in Scoring the Memory Test (Spearman) 


ORIGINAL 

SERIES 

CASE A 

i 

CASE B j 

CASE C 

Reproduced 

j Deviaiions 

Reproduced 

Deviations 

Reproduced 

Deviations 

3 

3 i 

0 

9 

* 0 

3 

0 

7 

7 

0 

7 

0 

7 

0 

9 i 

2 

2 


? 

2 

2 

4 ! 

9 

i 

9 

i 

9 

1 

2 

4 

1 

4 

1 

4 

1 

1 

1 

0 

1 

0 

2 

9 

0 

0 

0 


? 

0 

6 

8 

5 

1 


9 

5 

1 

5 

8 

1 

8 

i 1 


1 

6 

6 

_ 0 

6 

0 i 

6 

0 

Sum of deviations 

6 


12.9 


9.3 


>*The author is indebted for these illustrations to a personal communi- 
cation from Professor Spearman. " 
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(b) Suppose, Case B, that certain terms have been omitted. The 
deviations of the terms given are figured as before. There is then added 
the amoiuit of deviation to be expec ted for the omitted terms, on the 
asstunption that they are distributed l>y mere c bailee. The chauee devia- 
tion for each term is (if* — ih/. In t'ase B, then, there aie three 
omitted terms, em h of which dcviaie.s hy chance 3.3 place.s. Hence, the 
Case C, the totat deviation “ 0 -f 3.3 — - *J.3. 

(c) Siipjiosc tii d aS repruduce.s eertain terms more tlmn on(\% e. g., 
the digit *2 m Case C. In this ca.se, llu‘ ne.arcr of the two digits is con- 
sidered as the correct one. The other, or duplicated, term should be re- 
garded as an omission, and treated by the formula just given. Thus, in 
Case C, the total deviation — 3 -f- 3.3 ^ h.3. 

id) SupiKise that more than the correvt luimhor of terms rre repro- 
duced: here Hie .su]ierlh!ous numbers may be ignt>!^sl, since, save in 
exceiitional cases, they bring aliout tlieir own penalty by disturbing the 
eorres{>ondeiK e of order. 


It, THE METHOD OF LEITEU HQ LAKES 

The ideal of display ing’ siiniiltaneously a series of eonsoisants 
in a siuiple sjuUial paUern ajipi'ars first to heeu sii<; 

gested by Blind and Llenri (11) : the nietliod was exiended by 
Cohn, who used it (o ( Oinpari^ the redative vahu'^y for a given X, 
of visual and <d anditory-inotor learning; and it luis siiiei* betoi 
frequently used with inodifn ations (see, for (‘xainplo. Titeheiior, 
77, 390 tr.) as a method of studying idceiticnal types. Wineli 
used the method to compare immediate witli delayeri reprodue 
tion, Smith to comj>are various forms of disinn lion, .Viiderson 
aud Winch to note* tlie relation to sex and age, Wyatt to (‘om 
pare with school standing. 

MateiuaIvS. — A set of 19 ))rinied test-cards. rrepaiiHi forms 
upon wliich the rei)i*odiiction is entered. Sio}» watch. [The 
letter-sipiare cards are }>rinted in large ty[)e to make the test 
available for group procedure. The arrangeimmts avoid, so 
far as can be foreseen, the use of collocations (hat might serve 
as aids to memory. Only consonants are used. The blank forms 
arc ruled in sets of 12 scpiaros.] 

Method. — h^xplain to aS the general nature of the ticst. In- 
form him of the duration of exposure, hut givi* him no direc- 
tions as t<' how he shall attempt to learn the arrangenuait of the 
letters. Expose the stimulus card for 25 sei*. Ixd him till yut 
the blank form imimxliately after the exposure. Allo^v 30 sec. 
for writing. Repeat with other cards, until 4 to 10 trials have 
been made. 
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Vauiations n!' \! I. ! * 1 ) t liO re[»roil Ur t ioH for 20 

ser. (or It) , iu r,<5n’? ;U‘ior tlo expcj^ure. Diroct S 

io count alouO <]ursjc' ih>s ss.-.cixco. friroi 1 to 20 1 Tii]ni!)er per 
see., in tone \\n2» O' ^w;^o nn\v ;» c-a'chi ir.ctronoa'ie Hwing- 

i!tg on.'/ ;-cr s..r.; "i1n- oL.^,c(-’ ic n* xabdao or ernninato the 

‘inoHiuiy after i ninyc/ noO hi ‘.^cenoT tfj^ rccnil---iii the stiict 
senoa of !r.' rnoh': rc; (* x^'O icnce \\hi(!i h ul not been just })re- 
vioerOy ii: .. oie-rionsn^ 

(2^ lOcor* ;s tr, oaO !bt‘ r nlcaiil, M\ici‘ ov(u\ in conc(M*t 
\\'ifh /V. at nseo:hco^' ’ ret f-u* yc-r v ‘o. fb n\ horizontaJ lines. 
Hc'prodnt'.^ 'xon or \v;;'’r>ro iC’ 2'‘ .- -s* ‘.ntei'Vnl. 

{<\) Ibori so u ■ n; ;■•! ‘'.no ntinin ir-Oy and i'apidiv, (lur- 
ing th(‘ eyrjisnro. »Lo '■^x \\u ' ib'yrc.vluce prefei'a'oiy after 

tlH‘ 20 sec. nMc''od id^‘U a ?Ui tic.* xou'.tO^g. TIsis [(n'ni of pr(v 
< edurt‘ olA'rr*!!- !x .r\o;:, h,*.e \ '/oc; - ificoror;,. if more lhan one 
trial is irat! •. oDn r syi'biolc'^, sm-h as ‘La/ ‘Oh/ etc., to avoid 
t he lapsi' of an c nr ; n >ri ? o no nnuisnn 

f4 ) X Ic. ih't n!-nn ‘m 2V; duOiig the (‘Xposare ((?. f/., 

2, 4, tn on* t/, r>, V c! ■. ) o * to c.o’n^ backwards from 20. 

(5) Oifb. r ’‘/a. A b\ r.c, v af the ukO lunis just outlined, 
point 50 ora r-y; o- rr'-T]- ■n.'-a'a c of Lc.c boboi*: forms, in irregin 
Inr (UMicr, ask-ny a? on-nr or t-; v. idle the nrn,u*o})Fiate lettent 
as raijidiv a. -, pc-.,* oiibout pretions warning, ask S 

to fill in the V;aak sipjnrcs in lau'tical r<n\s, or in horizontal 
rows fk'om rsyia t»f c.e'L in t’n'ory, visual nnnded /s''s can ac- 
complish 1 ^ 0 ;.; . ihi rco clforj, wliciHaas purely auditory-minded 
aS's musl refrac; heir wu'btd o ‘^socia 1 itms tu find (he luwessary 
let ters. 

TiiOA'i'.r r>- r * 1 " Lvrv. - ( L) Foliowing AVinc]^ assign 3 for 
each letter in its ligh.t ]>ositii>n, 2 for each hdter one remove to 
the right, or left, cr ;ii)ove, oi* below its right position, 1 for 
<‘ach lettei* two riunovcs To tlie idght, or left, or above, or l»elow2' 

^Tbis iiietlcHi of scoring jxossilhy puts .soinowliat too much stress upon 
ri^'bt position: at least, in casis like the letter L in tlie si>ecimen it may 
be felt that 11 slimild not jro witlumt cridit because it is both in the wrong 
row and in the wrong colninn. However, the method above described is 
the one that has been followed by all who have worked with letter-squares 
-as a mental teat. 
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Si)C€imeii of test given Specimen of a marked pflpei 


M 

T 

D 

X 

M(3) 

T{3) 

L{0) 

Ed) 

V 

L 

Y 

N 

L(2) 

V{2) 

Y(3) 

Nui) 

s 

Z 

B 

R 

Z(2) 

B(2) 

S(l) 

X(,l) 


Score: 23 out of a possible 36. 


(2) If competent lo render introspective accounts of 

the rnaoDcr in which each letter was recalled and placed, E] 
maj, for qualitative purposes, compute separately the score 
for letters recalled visually, auditorily, or iu other ways. 


MEMORY FOR CONCRETE AND FOR ABSTRACT \VOK^>S 


The essential idea of this lest of laemory, as devised by 
inann, and followed, w ith some inoditlcatioris, by Burt and by 
Pyle, is to compare reproduction of a list of concrete, wcsh 
his reproduction of a list of abstract terms, given under identi- 
cal conditions. The comparison is based not only upon tic.; 
simple quantitative eibciency in the two forms of test, but aiyc. 
and more particularly, upon the qualitative analysis of the 
errora in the reproduced lists. Moreover, the test aims to de- 
termine not only ^S's capacity for immediate memory, but also 
his degree of intelligence, or grade of mental development. 
The test rests in principle uj>on two propositions; first, that 
wmrds whose meaning is understood are more easily retained 
and reproduced than words whose meaning is not understood; 
secondly, that progressive mental development implies pro- 
gressive comprehension of abstract w ords. 

Material. — For auditory j^resentation, use the following 
lists. For visual-auditory presentation, use the same lists 
printed upon sheets of cardboard with Willson's gummed let- 
ters. For visual presentation, serial exposure wdth the aid of 
the Jastrow or other exposure apparatus is recommended. 


Three term Hats Four -term Hats 


Concrete 

Street 

Ink 

Lamp 


^hairaci 

Time 

Art 

Route 


Concrete 

Sjxjon 

Horse 

Chair 

Stone 


Ahatract 

Phase 

Work 

Truth 

Thing 


Five-term lists 
Concrete Abstract 

Ground Tact 

Pen Scope 

Clock Proof 

Boy Scheme 

Chalk Form 
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Six-term lists Seven-tami hsts Eight-term lists 


Conerete 

Abstract 

Concrete 

Abstract 

Conciete 

Abstract 

Desk 

Space 

Ball 

Oaft 

Coat 

Law 

Milk 

Creed 

Si>onge 

Myth 

(^irl 

I’hougbt 

Hand 

Pride 

Class 

Rate 

House 

Plot 

('ard 

(iuile 

Hat 

Cause 

Salt 

Glee 

moor 

PlcHlge 

Fork 

Style 

Glove 

Life 

Cat 

Cue 

Stove 

Post 

Youth 

Mood 

Watch 

Box 

Mat 

Rhythm 

Faith 

Mirth 


The above lists are prei>are(l with the Mea of eontiniiig the 
ubstrju'f terms to words of syllable, as done by Burt and by 
Pyle (whose lists are quite similar to the above). This restric- 
tion materially lessens the difference in difficulty lietween the 
(oncrete and abstract lists. To duplicate Meiiniann’s condi- 
tions the following abstract lists may be substituted for those 
given above: 


b'onr-tcrm list 
Selection 
Analyses 
Explanation 
Olia racier 


Eight-icnn list 

Behavior 

Tciidency 

Interpretation 

Condition 

Opinion 

Capacity 

Profession 

Connection 


Fii'f term list 

Society 

Symbol 

Arran^?einent 

ITiimanity 

Tlicory 


Six-tcmi list 

(Conscience 

Invest I pit ion 

Symptom 

Formation 

Complexify 

Kxperiment 


A^ereu-ierm list 

Assunndion 

IbH'Ojulitlon 

Origin 

InfineiH‘e 

I>evelopm(‘nt 

Organism 

Value 


Method. ^ — For group tests, fol-ow MenmanrCK procedure. 
Explain the nature of ^he test and give a sample exenuse. Pro- 
vide each F) with blanks so arranged that his ]‘eprodiK‘tions may 
be pro])er]y re('ord(‘d, the lists carefully st-paraled, and dashes 
inserted fur all words omitted. Mak<‘ ch^ar that the lists an‘ 
to j)reserve the* order of presentation so far as possible. Before 
each presentation, notify the S'h of llu^ number of words to be 
sj^oken. Enunciate with great care, and without grouping, at 
the rate of one word per sec. Tnstrm t the aS'^s to widte their 
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lisis iiiuneSiately after the presentation, ainl as rapidly as jios- 
sible, without trying to Svrite their very best/ Guard against 
iuteiTuption, int' reoinnuinieation, or other jiossihle disturb' 
auees. Give the scTies in ord(‘r, as above, /. e., d-tenn eonerete, 
3-terni abstract, 4-terin eonerete, ete., save for mature N's, for 
whom the beginning is to ])e inad<' at tlu^ sliortest list that all 
can aeeoinj>lis}i, and for whom lists of more thau S terms may 
he arranged by eomhining some of the sliorUa* unused lists. 

Variations OF ^iFiaion.- (hmsnli sugge-siions for the numiory 
span for digits ( X'ariat ions of Ahdhod, / j o 7 ) . 

TREATivfFNT OF 1 )ata.~-( 1) Tlu‘ sim}>]es( imdlaHl is to <lisrt‘- 
gard the (jnestion (vf or<ler and sim]>ly to erodiii S one for (tu U 
word eorrec'tly recalled. This scoring was used hy SiiM[>soii 
Avith li>sts of IG words, hut is lud recomnumdtsl by him on ae- 
count of its failure to }»emilize for ei roFienus insert i<)ns. • 

(2) Another very simpl(‘ devirt* is that adopted hy Tyle of 
crediting one for (rich word corri-ctly v ‘piaulm ed, ])lus one 
more for each word phusal in thcTighi ordiue It is evidtmt lluit 
this scoring is not sptHdhc enougli (o deal adcpuaO'ly with llie 
various jiossihilit i(‘s of instMai<m, subsMh ut ion. iraiisp<Ksit ion, 
etc. 

(3) ^Temory for words ma\ be scni-cd h\ any one of lln‘ three 
methods already pi'oj)osed foi- mcniory span (Ti'eatment of 
Data!. 

(■1) Tln^ second metliod, propo-^tsl for ilc' memorv sjetn lat'bi- 
trary si'ores for \’aihons forms of ei'roi t is follow(‘d in prim i[)le 
hy I>nrt in liis s]U'ria] systenn of scot'ing nuamny for words: 
(*ach ('orriM't ^\au‘d corri'ctly jtim'cd ((Oints 1; fricli ('(nieet \\’ord 
misj)hu-ed hy one mo'i e ionnis F> ; (‘.n it ('orrc< i wto'd mis]dace(l 
by mor(' than one moia’ (Munns ; omissions oi* snh-a it uiions 
(‘oiinl 0. ■ Ullna* rnh\s whicli 'm‘ foIlo\\(‘d comm'm woirls with 
sliglit alterations; theste in llu auihor's jtidgmemt, ar(‘ not 
important emmgli to jnsiifv thmr use nnitvss nonstmst^ syllables 
are used, 

id) A xrry «‘la borate ana I \ sis of uMunory f'lU’ wcu'ds was em- 
jdoyed hy Vmimanm hov a careful scrntiny of !)h‘ j>erforniaiu‘(‘ 
in tills test /■; may ]>n‘fc]* to .idopi -.m h a m(0ho(i, follow ing as 
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a suggest ive ])atterii the schenia below, which has beeB trans- 
cribed from Meiunaim wiih a few minor modifications. 

ILLUSIKATJOiV OF TJIE TKKATMENT OF DATA IN MEMORY FOR WORDS 

Adolph L, xi<jc, S iicars. 


'l yp(‘s of E’-ror Number 

1. errors (omissioos and disjdacoineiit^) (‘onoretc lists. 5% 

2. ^leioory errors (oiuissioiis and displai^cjuents; , abstract lists. . 7% 

a. IiisiM'l ions. . 4 

4. Insert ions of nonsense words 1 

r>. Fii’^ions. 0 

0. l‘er.sev{M'atioiis . . 3 

7. (.' inhibitions.. 3 

5. Conipiete reverseis 3 

0. Sub'dii iitioii of syiiO!iy}ns * 0 

to. Sub'filntion of <‘<!nereto for abstriict. 3 

11. A\'i-<>n'-c tormnlloits. 4 

12. >.lisnndorr'tood abstract terms 5 

K>. Si)ellin, 2 .. Very bad 

11. liandwr.ilitur UndcvclopcMl and ugly 


(1) aisl (2) are i-(']>rcseiited by tlie integers, i. c., Adolpb L. 

omitted ii\i‘ words trom !!i(‘ (oiHiete lists, 7 from the abstract (the test 
was earric d to (lie "-term list oidy). ‘i>7s7>^e(r/ac?ibs‘ from the correct order 
ixnni! b'; (■: :’or when the dls'datenient is i>y one remove only, % error, 

w’aai inoi'<' than ont' renitna- t savfa that willi younger children, as in the 

<‘afe a!ro\‘r ail displ.tC(*menis count he) Hence Adolph made 2 dls- 
]>iae?'na !n'-’ in tlie ( 0 !i(i'e!<\ 7 in. tlio abstract series. 

(.‘H rti<o}s are the total number of words added. These are 

eonnfrd as i (‘rna* each, unless the added word has some similarity of 
,-;oiHa! to a rord .‘edually ])r('seinted, in which eiist' it counts % error. 

(-}) h'liis ridaic t>]n!uaees the relatively infrequent addition of a 

c/<' h//d'',ss ivord ilnU has no similarity in sound S})elling to any of 

tjjO^O JC’i ; ' *e h 

id) ; cvsn of 1 V \0 oi more totally independent, snc('Ossive terms Into 
;i einytt' o. ' : :)ny:(('ss K'rin are a vt'ry signitieaFit form of error, which 
apperns in ;resli‘'n t dsts wrilh'5i hy F’s of po.ir hdePipyneo, c. f/.. Organ 
and. :ir‘' ie[>redn(ed -a-. O'; gntiung. iMosti> naind in cliildreu 8 

and 5) y(sii .s oi<l. 

(*:>1 'r^rrcrai e.re inohsued by Ibe r( ‘ording by in a given 
of a word th.r; leid alcendy been reproduced in an earlier scries. If 
fri-nceiid diis a sign of ;t Ir-w irdedigenee, lack of seJl controI ami of 
(-r;ti(‘ai .rai:. nicnr. 

(7 ) -!y-(ii( n^drv luliiUlihn'H. Failure to reproduce at least one-half of 
tile teiao- ghen is. as a rule. 1() be interpreted as regressive inhibition. 
This coj-rdden i-; < (>ii;n:onIy adrihutable to a state of confusion into which 
a cbild is tin-own, when he is su'Td(‘n]y ‘overwhelmed’ by the task, wdien 
every! iiiiig 'dic.s oui of his mind,’ he ‘loses his wits,^ and Is unable to 
a(‘<'oinp!ish (woi^ a fra<'tion of hi.s normal performance. The s.ame thing 
is seen iji ad nits niKua' conditions wiiic-b are difheuh for them. Since, 
M('unainn arg(ws this is eweiitially due to inability to force attention, 
lack of this abd'ny is a token of poor geiu-ral ability, and hence of low 
iiitellig('i)c(\ Failure d«ie to absolute hick of intent to succeed must, of 
course, be dis( inmiisb-Ml fr*>in tl.e lack of ability to suceood. 
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(8) Vomplcie reversal of word order, either in a large portion, or in 
the whole of a list is “a peculiarly puzzling phenomenon.” There are 
occasionally met, for instance, eases in which a series of 8 words arc all 
written in the reverse of the order presented.’^ 

(0) The suhstitution of sy^ionyrns refers to the easily intelligible cases 
in which a word .f like meaning, but different sound, replaces the word 
given, c. g,, road for street, 

(10) The suhstitution of eonacte for ahstract ivonls refers to the use 
of concrete terms of similar sound, whether of similar moaning or not, 
r. g., COIC8 for cause, simple for symbol. E must use his judgment here in 
making allowances for faulty spelling, 

(11) Wrong formations, espetdally the use of wrong endings, consti- 
tuted a prolific source of error in the German tests, particularly with 
abstract words, e. g., Glauhheit for Olauhe. Errors of this type may be 
exfjected to he less fretj[uent in the less highly inflected and compounded 
English language, but occasional instances will ho found, c. g., sclcvincss 
for select iofL 

(12) Misunderstood ahstract terms is to he regarded (as the author 
understands it) as expressing the sum total of misapi)rehended ahstract 
terms, whether the misunderstanding is indicated by suhstitiUious, faulty 
endings, fusions, very faulty misspellings, or in other ways. 

(13) Orthography constitutes a secondary symptom of Intelligence. 
In order to estimate spelling fairly, papers are ranked as ‘poor’ in spelling 
only when the sum of misspelled words is 50 per cent, or more greater 
than the average number of misspellings for *S’s class, 

(14) Bandwriting constitutes another secondary symptom cf intelli- 
gence, and is merely rated, as fairly as possible by comparison of numer- 
ous papers, as good, average, or ix>or. 


These 14 rubrics are filled out for each 8. For the estimation 
of memory capacity, pure and simple, Meumann takes Nos. 1 
and 2; for the estimation of intellectual ability, he divides the 
rubrics into three groups, (1) those that serve as indirect in- 
dexes of intelligence (Nos. 1, 2, and 3), (2) those thni serve as 
direct evidence of -intelligence (Nos. 4 to 12, including a state- 
ment of the relation of Nos. 1 and 2), and (3) those that serve 
as secondary symptoms of degree of mental development (Nos. 
13 and 14). Now’, for each of these condensed indexes, the 
grade of each H is indicated as (1) above average, (2) average, 
or (3) below average, and final comparisons and correlations 
are based upon these grades. 

^''Thc author is inclincU in regard this i)henomcnon ns a simt)le case of 
attempt on the part of a few N’s to get the series right by beginning w ith 
the last word heard and working hack to the first section. ^ may have 
intentionally disregarded instructions to reproduce in the order given, or 
may have interpreted these instructions to include the reverse order as 
acceptable. In other words. It scarcely seems probable that the child does 
not know' that he has reversed the order of presentation. 
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D. MEMORY FOR SENTENCES 

• * 

In the first (1905) series of tests proposed by Binet and 
Simon there was included a test of memory for sentences; in 
the second (1908) series, sentences of 0, Ifj and 26 syllables 
were inserted in the tests for 3, 0 and 12 years, respectively; 
in the tlnrd (1911) series a test of iiien.m\y for sentences is 
used at 5 and 15 years. In my previous account of the 1908 
series I inserted a provisional set of 21 r uitences ranging in 
length from 2 to 42 syllables. These were subsequently tried 
out !)y Mrs. Squire, and another analogous set of 21 sentences 
was arranged by Carpenter when he repeated Mrs. Squire^s test. 
Abelson also used a set of sentences of progressive length in his 
test of backward children. 

Material. — Two printed slips each containing 21 test sen- 
tences (2 to 42 syllables). [For visual presentation, two pieces 
of cardboard.] 

Sot I is llio snino as tUat iniblishoU by the author as an adjunct to the 
Biiiet-Siinoii tests (1JX)8 series), save that the 11th soiireiiee has been made 
easier and the 12th and 17th sontoncos Iiave boon made liardcr to roniody 
the disorei)ancies found by Mrs. Squire in the original set (74, p. 379). 

Set II is the same as that published by Carpenter, save that the 7th and 
0th seiiteiK*es have been simplified to remedy the discrepancies that lie 
pointed out and that the lOlh sentence has been replaced by another, l)e- 
cause, ill my judgment, it differed markedly from the others in content 
and meaningfuJness for children. 

No atte]ni)t has been made to equate the two sets in respect to difliculty 
of corresponding sentences. Set II is probably less well-arranged than 
Set I. 

IMethop. — Explain to that he is to repeat, after once hear- 

ing, a number of sentences; that these will be given one at a 
time, beginning with an easy sentence and becoming more and 
more difficult. Make clear that he must try to repeat the sen- 
tence exactly, word for word. Let *8 sit with his back to 
Begin with a sentence well within grasp — say, with the sec- 

ond sentence for G-ycar-old children, or with the fourth or fifth 
sentence for older ones. Bead each seuteuce but once, slowiy 
and distinctly. Proceed until positive that no more sentences 
could be correctly repeated, until, say, 8^ has failed with three 
sentences in succession. Failure is recorded for any altera- 
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tion, even for a single substitution, insertion or omission. Re- 
peat, if desired, with Set II. 

Variation of Method. — For auditory-visual presentation, 
arrange the two pieces of cardboard to disiday the material, 
one sentence at a time. Let S read them aloud, once over, and 
immediately repeat what he has read. 

For the many other jmssible variations of method, such a‘ 
increasing Ihc number of ])resenta1ions, introducing an interval 
between presentation and re])roduction, see under Variations 
of Method in the preceding tests of rote nienioiy. 

Treatment of Data. — The simplest jdan is to treat the test 
as one of memory span for sentences, ^’s score would then b(^ 
the longest sentence that he could rei)eat without error. 

The difficulty which may then arise from missing one sen- 
tence and succeeding witli the next is perhai)s, however, best 
resolved by using for the score the total number of sentences 
correctly rei)eatcd ; thus, if the hi*st 8 are correct, ilie 9th missed, 
the 10th accomplished and tlic remainder missed, the score is 
sentences, not 8 or 10. 

On account of the individual differences in the difficulty ])re- 
sented by the same sentences to differeot the unreliability 
of the test should be lessened by using both sets of sentences 
whenever time permits; in this (‘ase the average score secure 1 
by the two trials may be taken as final record. 

E. MEMORY FOR TICTUKES OF OBJECTS 

The first Kinet-Simon series (1905) contained one test (Ko. 
17) in which a card of 13 pictures of ol\jprts was shown. Do 
croly and Degand used 3 sets of 8 j)ictures each. 3[rs. Squirt' 
and Carpenter used a card of 30 such pictures, while Lapi ' 
I)resented a series of 8 ]>ictures, successively, at the rate o" 
one per second. 

This test, which has an obviously close relation to thotesi 
of visual a])prehension (No. 25) and to Binet’s card of object: 
(No. 32A), would appear to have some advantages over more 
formal material, like digits and letters, for use with younger 
children. 
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Material. — Cardboanl on which is pasted small colored pic- 
tures of 13 familiar objects. Stop watc h. 

METHOD.—Explaiii the nature ol the test to S; inform him 
that he is to have half a minute to look at the pictures, and 
lhat directly afterward he is to name a. many of the objcHls 
as he can. For adults or older children it may be found desir- 
able to reduce the time of exposure to 15 sec 

^^MUATioNs OF AfETiiou.— Th(‘ mci'c' enumcralioii of the objects 
may be supplemented by a dcmiand for furl lieu* descrii>tion of 
them, especially of their colors, or of tlnur location on the 
cardboard. Mature /S^'s may be - cpiizzcd concorninj; their 
method of memorizing and rec*ailin<r the ju'etures. They may 
also be tested for lecop^nition by prc'sentinj; the cardboard, 
after they have named as many items as jmssible, to sc^e whether 
the omitted items can be rcmdily iTcognizcd, or they may be 
given a typewritten list of 30 or 10 objecis (including those on 
the card) from which they are to jnhdc those pn^sented. (Cf. 
Test 25, B and Test 32, A.) 

Treatment of Data. — Score one foi’ each object correctly 
named. Make record of insertions and substitutions. Note? 
which objects are most often, which least often nn alled. 

Results.— (1) Xornis of pcrforimuK c for memory vspan for 
digits will be found in Tables 01 to 01, for letter squares in 
Tables 05 and Ob, for words in Tables 07 and OS, for sentences 
in Table 00 and for pictures of objects in Ihible 100. 


TABLE 01 

yorms of Mcinonj-SiHiii for Digits, as Coinlitifnial hg {iSmcdlcu) 


A«E 

AUDITORY SPAN 

VISUAL SPAN 

j AGE 

1 AUDI TORY SPAN 

j VISUAL SPAN 

7 i 

5 

5 

1 

14 1 

1 I 

0 i 

1 

: 7 

8 

5 

5 ' 

15 

« 1 

1 7 

9 

5 

(\ 1 

IG 

G 

^ 7 

10 

t; 

1 G 1 

17 ! 

7 1 

8 

11 

iS 

G j 

18 : 

(i : 

7 

12 

t; 

[ 7 

19 ; 

7 

8 

13 

1 G 

i 7 i 





i 

^ ' 
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TABLE 02 

Development of Memory for Digits (f^mcdlcy) 


AVEBAGE AGE 


PER CENT. REPRODUCED 


Years 

Months 

i 

NUMBER TESTED 

Auditory 

Visual 

1 

7 

8 i 

19 j 

i 

36.4 ; 

35.2 

8 

8 

58 

44.6 i 

12.8 

9 


100 i 

45.0 ' 

17.4 

10 


89 

49.4 ' 

54.6 

11 


j 91 * 

55.4 1 

64.7 

12 

6 ! 

93 i 

55.7 

72.3 

13 

7 ' 

! 109 1 

! 57.9 

76.8 

14 

6 

1 114 ! 

1 I 

j G(».2 

80.5 

15 


1 94 

1 65.C 

78.2 

16 

0 

77 

i 66.9 

81.3 

17 

8 

1 56 

' 65.5 

84.1 

18 


1 25 

i 67.2 

77.5 

ID 

5 

12 

70.0 

85.3 


-J'ABLE 03 

Dependowe of Memory Span for Auditory Diyils on Aye (Jacohs) 


AGE 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

Nuinber 

tested 

1 8 

I 13 j 

19 

36 


1 42 

I 42 

1 72 i 

i G6 

50 

3u 

14 

Avera&c 
Span i 


: 

: 6.8 j 

7.2 

1” 

CO 

17.3 

1 

! 

1 7.7 

j 

8.0 

1 

8.0 

1 

1 

8.6 

8.6 


TABLE 04 


Dependence of Memory for Auditory Digits on Aye (Ebhinyhaus) 
(Average ?eumhcr of Errors per Pupil in Tico Series) 


AVERAGE AGE 

8-DlGlT SERIES 

8-digit series 

10-DIGIT SERIES 

6 TO 10 DIGITS 

10.7 

3.1 

5.1 

7.4 

17.8 

12.2 

2.9 

4.7 

7.9 

17.5 

13.2 

1.5 

2.(; 

4.2 

0.1 

14.4 

! 

i LG 

.3.0 

4.9 

10.5 

15.5 

1 LO 

2.1 

3.7 

7.G 

17.1 

1 0.8 

' 1.4 

3.9 

(15 

18.0 

0.9 

i 1.4 

L 

3.4 

1 

6.1 
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TABLE 95 

Mcmoiy for Letter iSqiiarcs, in Relation to Age and Practise (Winch) 


SCHOOL 

GRADE 

NUMBER 

TESTED 

AVERAGE AGE 

AVERAGE SCORE 

Average 

for 

3 Seta 

1st 10 Tests 

2d 10 Tests 

3d 10 Tests 

!x-vii. 

5 

14 yrs. 

3 mos. 

23.8 

29.0 

31.7 

28.1 

vii. 

5 

13 “ 

5 ‘‘ 

26.3 

27.9 

31.1 

28.4 

vi. 

5 

12 “ 

3 “ 

26.8 

32.0 

34.6 

31.1* 

V. 

5 

11 “ 

4 “ 

18.4 

22.9 

26.3 

22.5 

iv. 

0 , 

10 “ 

5 " 

21.3 

24.8 i 

26.6 

24.2 

iii. 

6 

9 “ 

0 “ 

1 14.1 

17.7 I 

19.7 

17.1 

ii. 

0 

8 “ 

2 “ 

13.2 

16.8 i 

17.2 

15.7 


*Tlie girls of this group proved to have special ability. 


TABL^E 9G 


Memory for Letter Squat'cs, Scoi'c for JO Trials (Anderson) 


AGE 

I CASES 

MEAN 

MINIMUM 1 

MAXIMUM 

8 

52 

108.2 

‘ 47 

198 

9 

92 

109.7 

i 36 

182 

10 

115 

127.7 

35 

213 

11 

126 

139.8 

60 

264 

12 

139 

157.8 

76 

272 

13 

125 

156.9 

52 

298 

14 

96 1 

165.6 

74 

283 

15 

58 ! 

170.8 

67 

323 

16 

25 

J81.6 

104' I 

318 


TABLE 97 

Memory for Concrete Words in Relation to Age and Sex (Pyle) 


SEX 

AGE 

8 

9 

10 

11 

12 

1 

13 

14 

16 

16 

17 

18 

ADULTS 

Male 

Female 

Cases 

Mean 

Cases 

Mean 

34 i 
31.2 

37 

32.9 

58 

32.4 

68 

32.7, 

1 

64 [55 
35.8,37.7^ 

69 152 
39.637.7 

60 

37.7 

70 

38.7 

60 

38.3 

j 

51 

40.4 

35 

40.0 

34 

j44.2 

I25 14 
40.2 43.4 

13 117 
42.0^42.5 

I, 

1 S 

40.5^ 

5 

49.0 

i 2 

52.0 

64 

44.3 

88 

47.6 
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TABLE 98 


memory for Absiract Words in Relation to Age and Sex (Pyle) 


SEX 

ACR 

Male 

Cases 


r\Iean 

Female 

Cases 


Mean 


1 8 9 

10 

11 

12 

13 

14 

16 

16 

17 

18 

ADULTS 

1 j 

134 '58 

63 

55 

fiO 

60 

35 

25 

14 

7 

5 

62 

22.9,20.3,26.8 

i 

31.7 

31.032.4 

1 

37.3 

34.1 

40.0 

41.1 

40.8 

42.3 

i37? 68 

69 

152 

69 

52 

31 

13 

17 

9 

2 

88 

120.5124.0 

1 

31.0 

31.8|34.0j36.0 

39 . 0 : 37.8 

1 

41.0 

37.0 

19.0 

1 i 

39.8 


TABLE 99 


Average yujnher of Sentences^ Correctly Reyeated (After Squire and 

Carpenter) 


AC.E 


Squire 

Carpenter 


6 

7 

. 8 

9 

1 

1 11 

1 

1 

1 

7.8 

8.4 

0.8 

lO.l 

10.9 

10.9 1 

13.5 

14.5 

5.3 

1 

6.0 

6.2 

7.2 

7.4 

7.7 j 

8.0 

8.3 


14 


8.5 


TABLE 100 

Memory for Pictures of Objects (After Squire and Carpenter) 


1 




h 1 






AGK ' 

1 ^ 1 

7 1 

8 

9 

10 

11 

12 


14 

Squire _! 

5.3 

6.5 

9.5 

i 

9.8 ^ 

9.1 

11.4 

10.5 

' ! 

10.0 j 


Carpenter 

5.3 

6.1 

6.0 

7.3 

7.5 

7.5 

8.4 

9.2 

mo 


111 comparing new data with these results, ditferen(*es in 
method must always he kept in mind. The ditferenees between 
Smedley’s condiu l of the memory-span test and that prescribed 
above has already lu'en described. The data of Table 02 are 
sliown graphically in Fig. 71. It will be noted that Table 93 
deals with averages, Table 01 witli standards of performance. 
Table 04 Ayith number of errors. Supplementing Tables 01 and 
03, W. V. Jlinghain has reported to me the following results 
for auditory memory span for digits, secured from some 200 
Dartmouth freshmen : median 7, P. E. 0.34, range from 5 or 
less to 12. 
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I am not able to explain tlie dilferenceH between the averages 
for letter-squares reported by Winch and by Anderson, save on 
the basis of selection of S'h: Anderson’s results were obtained 
under my direction at Ithaca, N. Y., and include children in 
the i^ublic schools with no attempt at selection. 

With reference to Table Oh, the dis^ cepancies between the 
results of the investigators are due primarily to two causes: 
Mrs. fe^quires' data refer to unretarded children only, and are 
based, as already explained, uiK>n a different set of sentences. 
That the first of these factors is the more i.aportant seems indi- 
cated by similar diviu'gtaicies in Table 100, where the experi- 
mental conditions must have been nearly identical. Other 
norms for sentences based u]um resnlls with the Binet tests 
include as standards: caj>arity to repeat a sentence of d 
syllables at y(‘ars, of 10 syllables at 5 years, of 16 syllables at 
6 years and of 26 syllables at 12 years. It is nnnecessary to 
add that much de]>ends u]M>n the sentences. 

With regard to Ta])le 100, it must be remembered that the 
a\'erages given are based iq»on a presentation of a group of 30 
objects; the use of 13 objects as s])ecified in the directions 
above will yield somewhat smaller averages; competent adults 
usually get but 11 objects after an exposure of 15 see. For the 
exjK)snre of 13 ]»i( lures Binet reported the following average 
performances: at 7 years, 4.3 pictures; at 0 years, 6.2 j)ictures; 
:U: 11 years, 7,2 j)ictures. 

(2) DepemhuHT 0)i age. That memory (*a]>aeity increases in 
general from the early to the late school years is illustrated in 
Tables 1)1 to 101. Tlie giun'ial evidtana^ is fairly chair that this 
improvement is stiauly up to pulxudy, but tlial it snlfers tluetiia- 
tions after that jieriod (se(‘ Tables 1)2, 1)1, 1)6, 1)7. O.S). ’ Several 
investigators adduce evidence that corroborates the ])n])ular 
notion that there exists a sj)ecial Unemorj' jxnaod,’ or stage of 
maximal efheieney somewhere in the deens,’ when memory is 
stronger than it is later. For example, the very careful Avork 
of Fohlmann, Avith varied materials and varied forms of j^res- 
entation, yields the net results (method of retained members) 
shoAAni in Table 101, in which maximal efiiciency is indicated at 
14, foIloAved by fluctuations, Aviihont real imjirovement through 
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tbe adolescent period. Bourdon could discern progress from 8 
to 13, but not from 14 to 20. Bernstein and Bogdanoff, in test 
ing memory for geometrical figures by the method of recogni 


TABLE 101 

Net E{]lciiac';‘ of Vurious Memories, in Relation to Age (Pohlmann) 


AGE 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

Average 










1 


Capacity 

39.4 

i 

41.4 

55.7 

59.1 

i 

(>8.9 

55.3 

62.9 

58.6 

58.0 

65.4 


lion, fouiul that 23 >S'’s aged 14 to 15 averaged better than the 
55 adults that they tested. Wessely, who tested retention dur- 
ing a long period (1 and 2 years), ivas convinced that ability 
to retain and re})rodnce poems is maximal at the years 12 to 14, 
and that vocabularies (Latin-German) are re])roduced more 
accurately at the expiration of 1 to 4 weeks, when learned by 
12-year-old, than when learned by 15-year old ^'^s. Similar 
assertions concerning the relative amount of retentive capacity 
for poems by children and by adults are made by Larguier (48, 
185 If.), while Binet (8, 259 if.) believes that children have the 
better retentive cai)acity, and adults the better attentive 
( apacity. 

Over against this evidence for a decline of efiiciency after 14 
we have the figures of Jacobs (Table 03) and the emphatic 
statement of Smedley (70, p. 40), based upon his Chicago re- 
sults (Table 02), that ^There is no hnemory period,^ no period 
in early school life when the memory is stronger than it is at 
an^^ later ])ortion of the chikTs life,’^ Smedley 's records do, 
indeed, show that ^^auditory memory develops rapidly up to 
about 14 years of age, and but slowdy after this y>eriod. The 
visual memory seems to develop rapidly up to about 15 or Ifi 
years of age . . . ^Tt will be noted [Fig. 71] that, in the early 
life of the child, the auditory memory is stronger than the 
visual memory; after about 0 years of age, the visual memory 
of most of the children becomes stronger than the auditory 
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memory, aud continues to develop more rapidly than the audi- 
tory memory throughout school life. Yet, even in the high 
school, there still remains a small proportion of the pupils 
whose hearing memory is the stronger.’^ 

The dependence of difTcrent types of memory upon age has 
been studied especially by Netschajeff and by Lobsien. They 
agree substantially that, whife the various forms of memory 
improve with age on the whole, there are periods of rapid de* 
\elopment, followed by no improvement or even by a reduction ; 
that while, on the whole, the greatt^st improveiiTent occurs dur- 
ing the years 10 to 12, and development is retarded after 14, 
yet the different forms of memory, consid(‘red specifically, de- 
velop at different rates, and at periods that may not coincide 
in the two sexes. Thus, in boys, memory for objects is at first 
best developed, then follow, in order of clironological develop- 
ment, memory for visual terms, for acoustic terms, for actual 
sounds, for tactual terms, for numbers, for abstract terms, and 
finally for emotional terms. For girls, the chronological order 
is: visual terms, objects, sounds, numbers, abstract terms, 
acoustic terniis, tactual terms, emotional terms. Special stress 
is laid upon the jiarallelism of development between memory 
for numbers and memory for abstract terms. 

In Meumann’s word-list tests, those types of error that indi- 
cate poor intelligence decreased with age, until, at 14 and 15, 
instances of misunderstood abstract terms were limited to 
about 10 per cent, of his while meaningless fusions, mean- 
ingless insertions, and the substitution of concrete for abstract 
terms had nearly disappeared, and the memory for abstract 
terms had so increased as frequently to be superior to that for 
concrete terms. It follows that age must always be taken into 
account in the interpret a tion of this test, particularly in esti- 
mating intelligence by it. 

Since in a memory test vso much depends upon the conditions 
of presentation, as will appear in what follows, I am inclined 
to regard many of these generalizations as of significance only 
under the partiAlar conditions of the testing. The one safe 
generalization as to dependence on age would appear to be that 
made at the outset, viz. : capacity for immediate verbatim re- 
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}‘ro(luction increases decidedly froiii t^arly life to ]ml)er1y, par- 
ticularly during the period between 10 and 12, and increases 
more sIoAvly and with fluctuations from puberty to maturity. 
The results of Cohn and Dieffenbacher, not here reprodneed in 
detail, also accord entirely with this .onclusion, as do the 
position of the medians in Anderson's [lercentile curv(’s (Figs. 
72 and 73). 

(3) Dependence on sc.i\ In general, girls pretty certainly 
surpass boys in immediate memory, but tlu. dilferences are not 
always marked and perhaps do not extend to all forms of mate- 
rial. Investigations that agree in showing a general suik'- 
riority of girls and women over boys and men are those of 
Anderson, Burt, Bolton, (^Jalkins, Kirkpatrick, Bohlmanii and 
Schuyten. Burt and ^loore state that only 12.0 per cent, of* 
boys exceed the median of girls, and add that ‘‘feminine supe- 
riority is a constant idienonieiion in memory tests of every 
kind. It matters little what the age <u* training of th(‘ subjects 
may be. Hence, it is one of the best attested sex-ditferemTM 
and one of the most likely to be innate.’^ 

The results of Anderson's extensive tests with letter squares 
have been summarized in Table 90. From Anderson's original 
data there have been arranged, after a preliminary jnwess of 
numerical ^smoothing,’ the percentile curves shown in Figs. 
72 and 73. 


Curves of tlii.s construction nro so valuable for diagnosing (be station 
of any individual’s ijerformance that these curves are here reproduced, 
despite the fact that they exhibit a number of irregularities due to the 
small numb(*r of cases available at certain agt's. 1 have also calculated 
from Anderson's data the tal>les of distribution (102 and lOR). It is 
therefore possible for any 77 to use these data by adding to (hem further 
scores and then recasting the percentile ( urves to accoi-d with the com- 
biiuxl data. .For tins purpos(> tlie scores may be considered as if they were 
the middle i»oints vvitliin the range.s here indicated; for example, the dis- 
tribution for 0-3’ear-old hoys may he read, 3 scores of Go, 4 scores of 
75, etc. 

By inspection of the medians (50th percentiles) in these 
charts it will be seen that girls are inferior t| boys at 9 years 

’T lind, however, some diliiciilty in identifying the figures upon which 
this conclusion is based, as they appear in Hurt’s different articles not to 
refer to the same groups. 








Ir. ^ 
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and practically the same as boys at 12 years, but that else- 
where the girls are superior and that their superiority is espe- 
cially striking in the higher percentiles. The curves are un- 
doubtedly affected by a poor gi*oup of girls at 9 years and an 
unusually gcod group of bo^'S at 12 years, since the progress 
with age is decidedly broken at these points in the manner 
ineiitioned. On the whole, Anderson figures, girls are some 
27 per cent, better than the boys in letter squares. 


TABLE 102 


DLslrihution of Boi/s" Scores in Letter Squares {After Anderson) 


AC. FI 

8 

9 

10 

11 

12 

13 

14 

15 

1 

GO- G9 

1 

3 

1 

1 






70- 79 

1 

4 

4 

3 


1 

2 



80- 89 

2 

5 

2 

3 

3 

2 

1 



90- 99 

5 

5 

7 

9 

2 

2 

2 



100-109 

5 

3 

10 

2 

o 

O 

6 

1 

2 


110-119 

0 

4 

9 

5 

3 

3 

1 

2 


120-129 

5 

6 

4 

4 

4 

3 

7 

1 


130-139 

1 

4 

3 

5 

9 

9 

2 

3 

3 

140-149 

0 

o 

6 

9 

6 

9 

4 

3 

1 

150-159 

0 

4 

3 

5 

11 

8 

3 

2 

1 

160-169 

1 

1 

3 

4 

7 

4 

3 

2 

1 

170-179 


0 

1 

4 

9 

3 

2 

5 

2 

180-189 


1 

0 

3 

3 

4 

3 

5 

1 

190-199 



1 

2 

1 

5 

4 

2 

1 

200-209 




' 6 

2 

2 

3 

2 

1 

210-219 




0 I 

3 

1 

' -3 

0 

0 

220-229 




0 

1 

1 3 

i 1 

1 i 

0 

230-239 




0 ^ 

2 

1 2 

1 

0 ! 

0 

240-249 


1 


1 

1 

1 1 


0 

0 

250-259 


: 


0 

0 



1 

0 

260-269 


1 


1 1 

1 




1 

270-279 



i i 


1 




1 

1 

Total-. 

21 1 

43 

54 i 

1 

61 

1 

72 

1 

68 

43 

31 

* 12 


In othei investigations the superiority of girls is either less 
clearly evident or exhibited in some aspects of the tests only. 
Thus Lobsieri's tests with varied materials (Table 106) likewise 
showed that girls reproduced more, but that boys were more 
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TABLE ion 


Dl^irihution of Girls" Scores in Letter Squarr,^ (After Anderson) 


ACE 

8 

0 

10 


12 

13 

! 

1. 

16 

30- 39 



1 







10- 49 

1 

2 

0 







:/0- 59 

0 

0 

0 

1 


1 




i;0- 69 

1 

1 

1 

1 


1 


1 


70- 79 

2 

l> 

1> 


2 i 

i 

1 

0 


0 


80- 89 

5 


3 

1 : 

1 

2 

2 

0 


90 99 
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3 
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1 
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i 

1 
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1 


Total-.. 

! 

31 i 

1 

CO 1 

1 

61 

65 : 

G7 

57 ! 

1 

53 

2G 

13 


apt to get the oraer rights ^ Nelsrliaj(‘ir also coia ludod that 
girls made more illusory errors (especially at ages 9 to 11). 
lie also found that bo 3 \s had the better memory for real onjects, 
girls for iiiinibers and words, in which the\’ surpassed boj’s, 
l)artit ularlv during the years 11 to 14. Wissler’s tabulation 


’•■’Note analogous results in the Test of Keport (Xo. 32) 



184 [550] ASSOCIATION, LEARNING AND MEMORY 


of the freshmen tests at Columbia University and Barnard 
Coiiege reveals sex did'erences in memory span for digits that 
are less than the P.E. of the averages, and that favor the men 
for auditory, and the wmrnen for visual series (Table 105). 

TABLE 104 


Pcrcciitafj^ of J^cin'acij in Mcniori/ for 2-placc Numhei's (Schuyten) 



MORNING 

AFTERNOON 

First lest 

1 

Boys ' 

58.1 

64.0 

(Afternoon ilist) 

Girls 

i 


77.5 

test 

1 Boys 

57.9 

55.0 

v.t, riiiiig ilrst) 

i Girls 

62.5 

55.1 


TABLE 105 


k>ex JJitfcrcnccs in Memory Span for Digits in College Freshmen 

(Wisslcr) 



AJDIT 

ORY PRESENTATION 

VISUAL PRESENTATION 


NiinCoer 

Average 

P. E. 

Number 

Average 

P. E. 

1 

i'.-fen 

^ 2G6 

7.6 

0.4 

142 

f).9 

0.5 

Y7oincn ' 

! o 

! 

1 l.?> 

1 0-5 

1 

42 

7.3 

0.4 


Pyle’s averages for memory for words show }K)ssibIy an advan- 
tage for the girls, but the differences are only slight. Cohn and 
Dieffenbacher, similarly, find that girls surpass boys only when 
groups of the same school grade and same social status are com- 
pared, and that when the results are plotted by age the curves 
cross each other six times, so that the sex-difference which ap- 
pears in lump comi)arisons turns out to be practically an 
accident. 

(4) Dependence on practise, (a) General. Practise produces 
a measurable increase in the memory span (Bolton). In the 
of nonsense syllables, indeed, the practise effect can be dis- 
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cciTiecl evea at the expiration of GO Gays of exj^eriinental work 
<Mnller and Schumann). 

AlGnch, from liis use of llie leUer-square, as well as of audi- 
tory letter series, *;Ot only dxM'lares that there is a ‘'marked 
and almost invariable improvement/” but ‘‘that ‘j)ui'e memory’ 
is markedly imj)i*ovable by ]U'aetise’' p KU). Thus, GS /^'s, 
ages S to over 14, obtaimal, in o sets of 10 tests each (1 week 
between tlie 1st and 2d, and 2 Aveeks between the 2d and 2d), 
the average scores 20.0, 24.1, and 2t).G { av( rages of the scores 
of TaldeOa). 

(h) The Irausfi'r of j>r(i(‘H.'<c ficnu tin* specially trained form 
of memory (o other forms of nuMnoiy would aj)])(‘ar, from the- 
oivtieal grounds, to be limited to those eases in which the mate- 
rial, (‘ontent, or method of ]u*ocedure of the other forms Avere 
related to the matcudal, eonlimt, or nunhod of ]U'Oc(Mlure of the 
trained form. This is ('ss(‘ntially the eonelnsion r(‘aeln‘d by 
Ebert and Meinnann (25, »>. 200), avIio say: “The objt‘etiv(^ 
results of our ex]>eriment shoAv that special memory practise 
is accompanied by a gen(*ral imj)rovement of memoi*y. Tliis con- 
eojnitant improvement do(^s not, hoAV(‘vei*, extend equally to the 
other bnernories,’ but a})pears to folloAv the laAV that the specific 
memories partici})ate in the imj)rovement directly in ])ro])ortion 
as they are related in content, or in media and method of learn- 
ing to the specific memory that Avas trainedd^ 

Winch has been led, by experiments in memorization of^ 
poetry and historical prose (81a), to take the more radical 
stand that ^‘improvenK'ni, gained in ])ractise in memorizing 
one subject of instruction, is transferred to memory Avork in 
other subjects whose nature is certainly diverse from that in 
Avhich the improvement Avas gained, ... at least so far as 
children of these ages and attainments are eoneerned.’^ Again, 
in his second paper (81b) he concludes that “improvement 
through practise in rote memory for things Avitb and without 
meaning is followed by improvement in substance memory for 
stories/^ and this even though the correlation between the two 
functions is very low and even doubtful. 

On the other hand, Starch found no improvement in auditory 
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memory B[)an after 14 days of drill in mental mnltiplication, 
.ind Sleight found no general improvement in his drilled e^?c- 
lions, save that a8's drilled in memorizing poetry or tables 
showed subsefiucnt improvement in memory for nonsense syl- 
lableSj on account, he thinks, of Ihe use of rhythm in these 
tyi)es of memorizing. Drill in memory for Uprose substance’ 
improved that sort of memory, but no other, and even worked 
disastrously for subsequent memorizing of nonsense syllables. 
The conclusions reached by Ebert and Meumann have been 
criticized by several wudters and dire(‘tly controverted by Wes- 
sely, w’ho says that for memory there seems to be no formal 
practise effect.^® 

(5) Dependence on fatigue. Though fatigue may affect im- 
mediate memory and undoubtedly does so when severe, it is difli 
cult to arrange memory tests that will serve as useful indexes 
of fatigue, particularly because either practise or ennui affects 
the results more than does true fatigue. On this point we tind 
Bolton, Ebbinghaus, Schuyten and Smedley in agreement. Tw'o 
investigators, however, have secured results wmrth mentioning. 
Winch (82) divided pupils into two equivalent sections and 
practised them with letter-squares until the rank-orders w’ere 
^steady.’ He then continued the tests wulh one grou}) in the 
morning, wdth the other in the afternoon. Both groups showed 
improvement, but the morning wmrkers imi)roved from 2 to G 
per cent, more than the afternoon w^orkers. Ritter gave up the 
determination of fatigue by span tests with numerals, but he 
did achieve results which he considers of special value by the 
use of 6-term series of two-syllabled nouns. With this material, 
he finds that errors increase wdth fatigue, and he goes so far 
as to assert that this test is the best one available for the in- 
vestigation of fatigue. 

^•Allusion may be made in this connection to the evidence for transfer 
found by Dallenbach witli experiments in the analogous field of visual 
apprehension (Test 25). Aside from the fact that Sleight worked with 
pupils as web as adults, it is possible that the discrepancies noted here 
concerning the transfer of practise may be due to the ages of the /S"’s 
studied. I have suggested elsewhere (JEdPs, 5: 1914, 302) that, particu- 
larly in the case of transfer, experimentation with children has been 
neglected and that results secured with adults may not necessarily apply 
to the mental processes of children. 
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(G) Dependence on physical eapacit;... Both Nelscluijetf and 
Sinedlov find that pnjiils that are larjijcr, stronj^er, and better 
developed physically have better ineniories Uian those of the 
eoiili'aiy ty[)(‘. “Tliis sn^u^(‘stsf’ says Sinpdley, ‘‘that the inline* 
diat(‘ sense nnanorv »s dejK*ndenl upon y xid brain formation 
and nutrition,” (See 70, pp. 58 50, for niinierieal e*\:idenee.) 

Miss Kohnky used nieinory span for di<»if ainon^' oilier tests 
in an investigation of th(‘ (die t of (bmlal treat nnuit iijion 
jnipils in a 5}h-^rad(* (Oncinnaii school. The S(M'ies with G 
di<j^i1s ])ro\'(‘d loo easy for tins woi'k ; the series with 8 digits 
yield(‘d virtually th<‘ same results for tr(‘a1(Ml and untreated 
)»u]nls, but th(‘;S(‘ries with 7 digits ‘yiehha] a gain of 10. S jier 
emit. b<dwe(m tests made in October and in tin* following i\Iay 
in tin* easi‘ of th(‘ pipiils Imving dental ti*eatment, as eontrastfsl 
with no gain in the pupils without treatment. 

(7) J)ep( nd('n(e <»\ the nainre of the niati'riaJ. {a) When 
diyits and an^sonani^ are given under the saim* (onditious, 
digits fire easici* to reproduce (J.acobs, SImrp), (‘Sjj(‘cifilly dur- 
ing the yi'ars 8 to Bi vPmurdon). But, if 10-jdac(‘ seric^s are 
pres(mt(Hl auditorily, thri(‘<\ the order of (‘xcellemi* for ri'call 
is (1) ( oiisonants, {2)nam(‘s of objects, (i>) 2 jilaei' numbers, 
(1) 'nonsmise sylhibles (Pohlnmnn). 

(h) IS'etscliaJidT, Lobsien, Polilmann, find less (daboratedy 
Kirkpatriil^ and Oalkins, ]iav(‘ eoinjiarc'd memory for series 
made up of la^al objeids, of numbm's, of sounds, ;nid of words 


aWBLB 100 

Mnnory for il h'nn Kf > /r,s‘ of Diffcrcul ICuoIh (F.oh^on ) 


1 

KIND OF SEFUK.S j 

I 


Real objects . 

Auditory numbers j 

Sounds j 

Tactual t^rnic [ 

Visual terms 1 

Auditory terms j 

Emotional te.ms i 

Foreign terms ' 

i 


SroriF IN TEF. CF.NT. CORRECT 


Buy a j 

CirlH 

82.2 1 

91.4 

(d.8 1 

71.8 

nttt; i 

(12.2 

(d.2 f 

71.0 

fio.t; 1 

G7.2 

59.4 1 

60.2 

31.2 

59.4 

24.0 

23.8 
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having characteristically visual, auditory, tactual, or emotional 
associative meanings. Table 106 gives illustrative results from 
Lobsien. Fohlmann, however, concluded that the assumption 
of Netschajeff and Lobsien that the presentation of visual, 
auditory, and other terms arouses the visual, auditory, and 
other imagery that their meaning implies, is erroneous, so that 
the results of these investigations are of little real significance. 

Kirkpatrick, and after him Miss Calkins, found, like Net- 
schajetf and Lobsien, that memory for objects (or pictures of 
objec-ts) was superior to that for words, both for immediate 
and for delayed reproduction; in the latter, for e\am])le, there 
were recalled seven times as many objects as words. The same 
investigators determined the order of excellence for recall of 
different kinds of words to be: — visual terms, auditory terms, 
names of objects. 

(c) Up to the 12th year, concrete iconh are reproduced better 
than abstract words, but 14 and 15year-oI(l ^’s frequently 
make better records with the latter, according to Meumann; 
but according to Pyle, concrete words are reproduced better at 
every age. The average difference amounts in Pyle and in 


TABLE 107 

Memory for Related and for Unrelated Words {'Xo^rsicorthy) 



Related Words, 288 Cases 

Unrelated Words, 270 Cases 

Age 

BOYS 

GIRLS 

boys 

% 

! girls 

i 


Median 

P. E. 

1 

Media’1 

P. E. 

Median 

P. E. 

Median 

P. E. 

8 ^ 

13.0 

1.0 

1 13.0 

1.6 

11.1 

1.6 

11.5 

1.3 

9 

14.0 

! 2.0 1 

14.0 

1.7 

12.2 

1.7 

12.4 

1.4 

10 

15.0 

i 1-7 

15.3 

1.9 

12.2 

1.7 

14.4 

1.4 

11 

15.0 

i L/ i 

16.5 

1.7 

12.5 

1.8 

14.3 

1.4 

12 

1G.4 

j 1.8 

16.0 

1.6 

12.8 

1.8 

14.0 

1.5 

13 

16.5 

1.8 

17.0 

1.5 

13.5 

2.1 

13.5 

1.5 

14 

10.9 

1.3 

17.5 

1.5 

13.7 

2.2 

14.0 

1.5 

15 

IG.O 

1.3 

17.5 

1.5 

13.7 

2.2 

14.0 

1.5 

16 

17.0 

i 1.3 

17.8 

i 1.5 

14.0 

2.2 

14.5 

1 1.5 

Adults 

16.5 

1.5 

17.0 

1.9 

12.8 

1.2 

13.0 

! 

1.4 
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Burt (16) to 20 per cent:, roughly, i. e., most &'’s recall about 
one-fifth more concrete than abstract words. 

((f) Related tcrmSj L a series of words not in a sentence, 
but readily 'associated with one another, are nK)re easily re- 
called than unrelated worcjs. For data, see Table 107 from 
Miss Norsworthy. 

(( 3 ) Material so arranged as to aid local' ation is more easily 
remembered, especially by children. For example, 12 con- 
sonants in the letter-square form are easier to recall than 12 
consonants in a single line; similarly,- digits pronounced in 
rhythm are easier to recall than digits pronounced in even 
tempo (Muller and Schumann).' Fohlmann found grouped 
series to be easier in 133 of 144 trials. 

(8) Dependence on sense department directly stimulated. It 
is evident that a complete isolation of the different modalities 
cannot be accomplished by different fofiiis of presentation : e. g., 
auditory-minded /8’s may actually retain and reprochice impres- 
sions presented to the eye in auditory, or mainly in auditory 
teriuis, and so on (cf. Abbott and Finzi). It is also evident that 
what seem like minor variations in the manner of coudiicling 
the lest may occasion considerable variations in the perform- 
am'e of aV’s. These facts account for miirh of the divergence 
and seeming conli*adiclioii in the results of various investi- 
gators with regard to the relative advantage of addressing 
stimuli to ditl'ereiit senses.^' 

With regard to the relative advantage of auditory over visual 
presentation Kemsies found presentation by ear the better for 
Latin words and for nonsense syllables; von Svbel found audi- 
tory } resentatioii better than visual for both auditory and 
visual tyjies of ^’’s; Ilenmon found as his most sfriking result 
a marked superiority of auditory o\er visual prescrilatio ? for 
all of his aS's and for al! forms of material. ILnvlvi:,,-: lO; v A d 
that »en nouns heard are recalled better tlmn ten nouns siaj 
ccssively seen in the case of younger but that the reverse 

■^^These aiver^cencios hnve been well siiiimnirized by IIcLiinoi:, lo wUc-o 
account the reader is referred for details of the coiiclu>ii.:is reachvu by 
Meumann. M'insterberj; and Bijjhain, Quant?, Lay, Itschner. Fib hs ai.;i 
Uaggeiiiiiullt y Cohn, Kemsies, Finzi, Frliiikl, Segal, veii S\bcl, Schu^^eu, 
Pohlinann and others* together with his own coiiclusioiis. 
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holds true for above 15 years. Pohlmaiin^s extensive experi- 
ments, which are criticized by Ileninon because of being con- 
ducted by the grou[) method, show that auditory presentation 
is better for nieaiungful material (words), while the reverse 
is true wHh nonsignificant material (digits and nonsense 
syllables). On Ihe other hand, the superiority of visual over 
auditory presentation appears in the tables and charts of 
Smedley and in Chambers’ results for 7th and Sth grade pupils. 

With regard to the advantage of combined appeal to eye and 
ear or to eye, ear and motor memory (articulation or writing), 
there are similar discrepancies. The work of Pohlmann (Table 
108) indicates a superiority of auditory-visual presentation 
over either auditory or visual ])resentation, alone — a result in 
accordance with ^medley’s. Pohlmann also investigated the 
etYeet of these three forms of presentation upon numerals and 
nonsense syllables, with, the result that for .2f>0 VoUcsschtiJc 
girls, using 10-term series, given thrice, the percentage of accu- 
racy was, for visual-auditory 53 iier cent., for visual 52 i)er 
cent., and for aiiditoiy 42 per cent., which agrees iii substance, 
so far as it goes, with Smedley’s results for digits. This investi- 
gator found the order of superiority to be: (1) auditor^’-visual- 
articulatory, (2) auditory -visual, (3) auditory-visual-hand- 
motor, (4 ami 5) visual or auditory (depending on age). Illus- 
trative figures for a 8'S aged 10 years are, for the five forms just 


TABLE 108 

Dcpcn^Icncc of Memory upon Form of I^rosoitatkm {Pohlnuinn) 
{Vcrcchtiujc of Retained McuiherSy lO-Tcrm Sm'ics, 3o0 Pupils, 9-1/f Years) 


NATURE OP MATERIAL 

FORM OP PRESENTATION 

per- 

centage 

RETAINED 

1. Actual objects 

Shown and named by E. . \ 
Shown, only, successively 
Seen and beard by . . . 
Heard, only, by tSf 

72% 

70 

55% 

50% 

49% 

2. Actual objects 

3. Names of objects, 

4. Names of objects 

5. Names of objects 

Seen only, hy . 

0. Names of objects 

Seen, heard, and pro- 
nounced by 




In the upper classes, 5 becomes superior to 4. 
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inentioned, 88.4, 8G.9, 82.4 (circa). 80.0, and (JO per <‘cnt., re* 
spccHvely. Coaibiucd appeal is, then, most powerful, hut the 
task of writing proves somewhat dislracting. MOnsterherg 
and Bigham conclude, similarly, that “a series of imj)i'essions 
(OTered to two senses at the same time is much more cosily re- 
produced than if given only to sight or only to hearing.” Thus, 
in the case of 10 numbers (he per ceut. of error for numbers 
luaird, seen, and both seen and heard were 14.1, 10.5, and o.O, 
resj)ectively. On the other hand, Ilenmon concludes that \ isual- 
uuditory-inotor [)resehtatiou is slightly inferior to the auditoiw 
and to the auditory-visual, but superior to the visual alom‘, and 
that visual auditory jiresentatioji is slightly inferior to the 
auditory alone, while decidedly su])erior to the visual alone. 
In general, he found the advantage of combined lu'esentalion 
much less than that reported in earlier investigations. Kemsi(*s 
discovered that visual-auditory )>reseiitatiou usually gavi? 
poorer results than visual or auditory alone in t(‘Sts with Latin 
words and nonsense words. 

The question as to whether articulation does or does not 
assist in subsequent recall is also answered dilferently by dif- 
f(*reut investigators. Thus, Coliu found that in memorizing 
consonants all his aS’s did be.st when they read aloud, less well 
when, speech movements were supjuvssed, least well when niim- 
hers or vowels were pronounced as distractors during the read- 
ing of the consonants. Quite similar results which were 
reached by Lay in his investigation of tlie teaching of spelling 
have been contested by Itschner and by Fuchs and Jfaggeii- 
muller. Heninon a Isq^ declares that articulation or vocalization 
is of little value for immediate memory. 

A closely related question concerns the ]K)ssi))ility of (k'ku* 
mining ^8 s ideational type by scruuny of liis performance under 
different sorts of i)resontation. Frank! and also Segal believe 
that visual presentation gives better results with visual types, 
auditory with auditory types, and Meuiuann concludes from 
such tests that in learning, better reliance can be jilaced upon 
8’s type than upon an appeal to several sense dejjartments. But 
the evidence is fairly clear that, as Angell says, while memory 
tests ^‘may certainly be so administered as to show over what 
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sensory arcs the best results may be achieved in assimilating 
information of various kinds ... as objective tests of imagery 
aj)art from introspection, they have few virtues and no relia- 
bility.’^ 

(9) Siiccissivc vs. sun iilfa neons presentation. If 15 words 
are exposed simultaneously or successively for equivalent 
jengths of time, successive presentation is easier for young, but 
siiiuiltaneous for older children, according to Hawkins. 

(10) Dependence on numher of presentations: repetition. 
rohlinann, Lipmann, Smedley, and others have found that hear- 
ing a series thrice or twice, instead of once, improves its recall. 
However, Hawkins found two hearings less* effective than one 
or three. It is certain that more is accomi)lished in the first 
hearing than in a large number of repetitions, and that the 
effect of rei)eated })reseiitation is different in different so 
that individual differences are more marked after many hear- 
ings than after one hearing (Smith). Smedley’s test of 38 
10-yeai’ pupils, witli auditory digits, gave, for the first hearing 
JT per ((‘lit., for the second 55 per cent., and for the third 50 
]K‘r cent, correct re{H()duction. in some of Smith’s tests, 12 
presentations did not double the etiicieney attained in one 
lu'csentation. 

(11) Dependence o)i rate and, duration of exposure. Berg- 
strom’s tc'Sts indicate tliat nonsense syllables exjiosed at the 
rate of one in 0.77 sec., with durations of exposure of .041, .082, 
.1G4, and .318 sec. yield practically the same results, though 
there is a slight preference for .082 sec. 

The same investigator found that, bolh with auditory letter 
and word series and with visual nonsense-s^ffables series, a 
l elatively slow rate of exposure (1.5 to 2 sec. per term) yielded 
more accurate results than a faster rate (one term in a fraction 
of a second). The slower rate is especially helpful in lists of 
words, and for those that, try to develop associations be- 
tween tlie terms as they are presented. Bergstrom summarizes 
by saying: “The acquisition and retention of a series of fa- 
miliar associable words varies approximately as the logarithm 
of the interval at which the words are spoken” (6, p. 221). 

(12) Dependence on interval between presentation and repro- 
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diiclioil. Relatively short intervals niake, apparently, but little 
change in reproduction. Thus, Winch could discern no clear 
differences in the rejiroduction by school children of letter- 
s(iuares, with or without a 2r)-sec. empty interval between 
presentation ahd reproduction. 

Binet and Miss Hharp compared immediate memory with 
‘recapitulatory’ memory (memory of cons/ ’vation) ; they both 
noted that the word lists in immediate reproduction seemed to 
be held largely by sound (so that, for exanii)le, such errors as 
flinn r for floor wer(‘ common), whereas lisus reproduced 3 min. 
later a])}iear to be held more often by meaning, since '‘the errors 
are us\ially additional words sugge^sted from analogy of sense'* 
((’. //., (lot/ suggest('d by caty cold by wintcry etc.).^’'^ 

Attention has already been called (7, h, tibove) to the demon- 
stration by Kirkpatrick atid by Calkins that the reproducibility 
of different forms of material is not ecptally affected by a 3-day 
intc'rval. 

( 13 ) Effect of distraction. Smitlfs use of the method of let- 
1 ( 0 ' stpiares (71), with and without the distraction of concom- 
itant activities, shows the ordca* cd (*tliciency under these con- 
ditions to be, from In^st to worst :—(l) without distraction, 
(2) witli tapping to tlie beat of a metronome, (3) with repeti- 
tion of a vowel, and ( i ) with counting by 2's or 3's. Cohn, with 
the same test, found that an auditory-motor was more se- 
riously disturbed by auditory-motor distractors than a visually 
minded /S', and that, when such distraction is used, visual 
memory steps in to aid. ])rovided /SAs constitutional make-up 
(A 7 dagc) will at all permit (22, p. 182). 

(14) Reliahiliti/. Witii the exception of Brown, whose co- 
efficients were only ,50 to .08, investigators have found tests of 
immediate memory to yi(‘Id a satisfactory degree of reliability. 
Examples are: Burt, .70 for one group of /8’s, .93 for another; 
Wyatt, .75 for one group, .70 for another; Abelson, .74 to .81; 
Simpson, .73 for all aS”s collectively. 

^The tendency of adults is away from rote momonVJng in favor of a 
memory of iiifvuiinj2:s. It would, then, he interesting to se(? wliether rhij- 
dren exhibited these same tendencies that Sharp’s university students 
did, or exhibited them in as marked a degree. 
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(15) (Correlation irith inaiial ubilih/. Ebbinghaus 

(Table aii<l ^^‘iss]eT• (wlio foiiiid w cori'claliou of but 0.10 
bet^v(M*u ci.iss slaadiiig aiul the menu»ry eapa<'ily of Eoluiii* 
bia freshniei) ) seeju |o l)e the ouly invest [ors to (hniy a l e- 
lalioiishi|> between iiniuediate ineiuory and intelli'^can e. Jaeobs, 
at the olhee extreme, asserts that there is a “notable eoneoiii- 
itaaee'^ between school staiidinji: and ‘‘span of ])reheusi(;n/’ 
Thetrutli Avonld a{>})ear to lie, as usual, b('hv(H‘n these ('x(r(mies. 
The more ear(*ful < urrelational work of lh(‘ ])as( few years 
demonstrates at hast a fiiirly j;x)od d(‘i;r('e of eorresi)ondenee 
between immediate memory and either school standing or esti- 
mated general intelligeiiee. The several investigators who have 
found eorrespondenee of this sort have exj)ressed their eon- 
elusions with certain vestrietions or explanat ions, as wall aje 
} ear in what follow s. There is some evidence, for exanijde, to 
indicate that the corres}K)nd(‘nee Ixdw'een immediate memory 
and school standing is closer in the lower than in the higher 
grades, and that the corresjiondence with general intelligence 
i:t closer with. tests of delayed than of immediate recall. 

TABLE ICH) 

of Meniorji for Auditor)/ J)i(ji{s and InlcUi<jrmr {Ebldmjhaus) 


AVERAGE NUMBER OF ERHOHS PER PUPIL 



Brifitit 

1 Group 

1 Average 
j Group 

i 

1 Dull 

1 Gioup 

9-digit test _ 

..J 84 

1 

1 87 

i 81 

10-digit test_>- 

1 147 

1 147 

135 

0-10 digit tests, coilectiveiy 

i 318 

1 j 

i 319 

' 1 

303 


With backward children Abolsoii found rather low correlations, 0.18 
and O.Ta, beluxa'ii iiiujiiory for names and iinuiitod practical inlelliiJjence 
(compi*t(Mi( V U» pi'i’torm errands), but lii.i^lier correlations with school per- 
lonmoiccs (O.eo nnd O.L’t with estimated ability in reading and 0.30 and 
0.32 with estimaUal ability in aritliinetic). 

Binet (8> eontrasted (J dull and 5 bright boys, and found that, on (he 
whole, the latter surpassed the former in memory: the difference, as in 
his tests of otluT traits, was, however, more evident at the first, than at 
any subsequent trial. 

Brown found correlations of 0.40 to 0.50 with school marks and 0.40 to 
0.55 wdth estimated general intelligence. 



TEST 38; MraioRv for sfriai. iMi‘ni:ssu»Ns joGiJ 195 


lUirt esliiiKitc'cl inlellisnice in A’arious AT:.ys and ineasui'od iiH'inory lor 
com rote words, abstract words and nonsense syllables. The correeled 
correAitiojis for estiniat(‘d intelligence and gimeral standing in Die memory 
tests were 0.60 for Fdeinentary School, and 0.8- for ITcpaiMtory School 
boys. Tin? nneorretded coj-relatioiis were liighcr for inomury lor com pete 
words (O.ns and 0.8 J\ than for memory for abstract words iO.lS and 
0.7S) ; fur iioiisei'sc syllables were 0.4d ir d 0.75, while tin* amalga- 

mated meiiioiy icsis correlated by 0.07 ami o.OO with examinations in 
inatlicuiatics and by 0.82 with examinations in literary subjects (in the 
rr(i)a;aloi y S<hool). Burt argues from these ngiires that the current 
examination system stresses ability to remember. Meumauu’s conclusion 
lliat brigJn children dmolay a relatively siii)erior ability in memory for 
ab.'^li act teriiis wa- not siilistamiatcd by Burt. 

( \)hn and Dieficnbacln r divided their into two groiii>s — the betiia* 
and llu' ])o()ror inudicclualiy. 4'lie former excelled the latler in the 
jnein«ay tests in 11 oT his 11 groups; the siii)eriority amounted to abimt 
10 per ((Mil., and turned out to be loss *iu the higher than in the iowi r 
sdiool grad(‘s. 

Jai])U‘ eonti-asted pedagogieiilly advamanl wilh pedagogieally tetarded 
impils, aJid eoneludeil that these groups differed little in reteinivo iiower 
as such, lad that the retarded pupils frtM|ueiilly K^produi'od the material 
in bizarre and eontradietory eombinailons, r. //., asdn sjieaking of “a .voting 
peasant 54 .\'ears old.’’ 

Meiimann says that the (piantity of material re])rodue(Ml is not in its»4f 
a reliable index <»f intelligeiu'e, ,>et th(‘ a\erag(' r(‘stdt.s of mass e.xpeii- 
nients will always show that (lie more iurelligeiit 8'\s have the heller 
imanory ellkitMiey. ili.s vwvn exiierimenls, lut deelaia's, wma* so exten.^ive 
and so earefully executed as to leave no doubt at all niion thi.s iioint (51, 
p. 78). I\[or(‘ reliable, however, are the qinilitative results attaim'd from 
memory testfi (if tin* lorm irmd in his own experiments. 11 ('re, he says, 
vh'lually complete coincideiiee is found between the several inde.xes of 
inteliigeiUHM and Ix'lwt'en thtmi and the school marks and thi‘ ('siijuate of 
uientai abil!(;\ .by teachers. (7‘rtain < haraeteristic -indoxes of I’/oor intelli- 
g(MiC‘', hi)\v<‘V<' siieh as tin' fusion of abstract terms into imainingless col- 
locations, mtiy not be sbowii by all of the stupid ebildren ; if tiny art' 
sliowii, t!i(\v lorm a reliable index of poor intellig‘ene(*, while if I'laMpu'id, 
tlH\v indicate not only in>or intidligtuiee, hut .also (lie laei; of nioial (piali- 
tK‘s, sueli as sidf coiifioi and eartd'ulness. liieidenlally, Miamiann ))oinls 
out that, in the<ir\, v ,> should dht htguisli eau fidly h< twecai nalural ability 
;ind a(inal ability shown in school ina'ronnani e ; tlu se, ne\ evHn‘U‘s.s, 
tend to i oineicie in practise. 

lk)ii'!n;ann. lilve idiieh dealt witli i-ontra^ttMl grouj)S. IJ(‘ concludes that, 
while in gu'iicral the la ttcj* pupils h.ive belter memorii's, tiicre are numer- 
ous cxct'ptions, i)artii‘ularl> in that poor i-upils may do as wadi as lu ighl 
pui)ils in the memory tests. 

TIuMwo contrasti'd groiijjs (»f adults tested b.v Simpson were fairly wadi 
separated by ifis tests of memory for words; none of the poor groui) 
roaidied the media ii, perforinaiu e of the gO(rd group, and only 10 per cent, 
of tlio poor group w(*re as good as tlie lowest 0 ])er ceail. of the good group. 
The correlation with the estimated iutelligenee of the g<x>d group was 
0.03. 

Smedley declares that the “parallelism between school standing and 
memory ixrw e* holds good throughout school life” (70, p. 54), and demon- 
strates this by reference to mass results distributed to show' the memory 
capacity of pupils of a given age in different grade.s (Fig. 74), or the 
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capacity of pupils at and above grade as coini»ared with the capacity 
of pupils below grade at different ages (Table 110). 

Winch’s letter-square tests convince him that “general mental ability 
[rank in exainihatioiis in reading, arithmetic, dictation, and Eiiglisli 
composition] is accoinpanied by good memory.’’’ “With two exceptions, 
no girl whose nieinory mark is relatively low has a high place in class.’’ 
“ ‘Good meiiK ry,’ tliough usually accompanied by general etliciency, is not 
invariably so.” Again, Winch contrasted six- 13-year-old girls, who stood 
between Number 1 and Number 11 in a class of 3o, with (» girls of tla^ 
same ago, who stood ‘25th to 3()th in a class of 3h, and found the average 
score of the bright girls to be as c(>mi)ared with an average s<()r(‘ 
of lU for the dull girls (8tl, p. 133). 

Wessely believes that the correlation between memory and class stand- 
ing is more evident in lower than in higher grades — a view exi)ressed 
also by C’obn and Dieffenbacher and which, if coiitirincd, might be ex- 
plicable bj'- the tendency to put a premium \ipon memorization in llu' 
lower grades. 

'Wyatt’s tests with nonsense syllai)les gave as a correlation with intel- 
ligence 0.59, P.E. .07, for immediate and 0.74, P.E. .00, for delayed (‘2 
days) reproduction; his tests with letter siinares gave a neg]igihU‘ <'or- 
relation 0.18, P.E. .11, 

(10) Manory of defectives, Galtop applied Jacobs' tests 1o 
imbeciles, and found that most ^V’s of this type failed to i'(‘peai 
more than 4 digits, while several imbeciles who had remarkable 
memories for dates or for passages in books showed comjdele 
failure (span not over 3) in memory for digits. Johnson com- 
putes the average span for feeble-minded (selected >S’'s of tlie 
so-called Vhool-case' grou])) at 5,3, or api)roximately 1.3 digits 
less than the normal span of an 8-year child. The distribution 
of efficiency, as he found it, is -shown in Table IIT. Johnson 
comments upon the fact that the difference between the memoiy 


TABLE 110 

Relation of Memory for Digits and School Standing {Snicdley) 




— 

AUDITORY 

VISUAL 

AGE 

NUMBER 

TESTED 

Average Standing? 
of Pupils At and 
Above Grade 

Average Stand- 
in#!: of Pupils 
Below Grade 

Average Stand- 
ing of Pupils At 
and Above Grade 

Average Stand- 
ing of Pupils 
Below Gi ade 

9 

99 

47.8 

39.7 

5D.n 

4].9 

10 

88 

54.4 

4‘2.7 

61.6 

46.2 

11 

91 

59.0 

48.G 

69.4 

53.3 

12 

92 

G2.G 

52.2 

76.7 

66.0 

13 

110 

70.4 

64.3 

j 80.7 

72.3 

14 

116 

68.9 

62.6 i 

i 87.6 

74.9 

15 

94 

68.9 

62.4 

80.9 

75.0 

16 i 

75 

70.1 

65.8 

83.3 

78.8 

17 

56 

67.5 

62.7 

87.8 

81.2 
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Grade 



Fl(-.. 7 
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TABLE 111 

Mono}'}/ Spiui for Digits iff the Fevhlc-Miinlcd (Johnsion) 

^ ^ ^ ^ 

Number of (b^iis 4 | r> • G | 7 | 8 

Repeated eoircetly by | 70 j G(i , 51 : 27 i M | 4 

Non-: -The lar.^or ^i()U[>s iie hidi^ IIk' smaller ones at llH'ir 

sjjaii of IIk* f(‘(‘bl('-inin(kMl ami of normal (bildrcm secans (o Ik* 
of a smaller orib*!- lliaii tin* i;(‘neral (liUVrenee in intellcel ual 
abililv of tlio two groiij)S. 

]\liss Norsworlliy comnaiaMl noinial ami f(‘(‘blc-nnm1(Mi cliil- 
dreii with vi^speei to memory for ndalial ami for nnrela{(*(l 
words. ]{(‘v siandards for normal eliildren hav(‘ alreadx Ikhmi 
leporU'd (Tabl(‘ 107 i : tin* i'(‘laiion of fe(*bl(* iinnd(*d io iiormal 
ellieiemy is sliown in.Tabh* 112. Tin* fi;^ni‘(‘S arc* lo Ik* inler- 
|H‘(d(‘d sinijdy: Onc* per c‘(‘nl. of lln* fc'eble minded do as ^^■^*ll 
A\ ilb Ihe i*elat(‘d word tesl .as do 50 ]K‘r cent, of normal eliil 
dren, ele. 

Sm(‘dley slab's “dial tin* boys of die dobn \\\)rdiy School 
j inc'orri^ibles, defeedves, truants, et<*.| arc* Io\\(*r in mc'inory 
j>ower tJiaii aia* (In* ]mpils of tin* odn*r schools, and this dis- 
pa i*ity incrc*ases with ajj^e'’ (70, p. 50). 

Smith's tests with epih‘}dies (72,) show that, in the auditoiw * 
le tter span tc'st, thc'y aia* <i(‘nerally inf(*rioi‘ to nornial N's, and 
in ])ai'deular, that du*y make* ne*arly Ihre'e times as many e*rre)rs 
‘f insertie)n. 


tabu: 112 

Vo)n}}<n (ttivc Monni'}} (Uipm iig of Formal inid FrdtU'- M indvd ('liihlrcn 

(Korsirorthi/) 


ABOVK AT50VE . AHOVT- 

MEDIAN - 1 I’. K. ' - 2 r. !■. 


Normal (both test<) 50 

Fee'ble mindeel, in related words ‘ 5 

Feeble-minded, in unrelated words ! G 


75 01 

19 00 

18 ; 27 
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(]7j (jlhv)' conrJdtions. Kiiipf^er iuul SjK'iuinan found ii(» 
coirelalion belwouii iiuunorv for diiiifs (s^uial visual r\})osure) 
and ritluu' abilily to add, 1o discriiuiiuaii* or jo disrriiiii- 

uali* dual <*ujaiu*ous iiupiessions. 

]\l(Uuory for dibits aiul ukuuoi'N for ItUlois wcuo coiielajcd to 
a bruli de^ivp in SbariTs aVV, while lueuiorv for sborj siui 

j(uie('S eorrelaied besl ^\•ijll lueiuory for lellei s, 

Sju(Mlb‘y sludied llie rcdalion of nuunoiy for di<;ils and abilily 
io sjiell, and (‘oneliub'd iliaf ‘‘wldh*, on 1lie wliob\ llie ^ood 
spellers have decidedly betler ineniory ])ow{'r Iban lli(‘ bad 
spellei's, yej (Inu'e are individuals ainoipi*- Ibe ]>o(U' sjxdbus wbo 
are superior ill luenioiy ])OW(‘r. aifd individuals ainou^ IIk'. Ik^si 
sjudb^rs \vbos(‘ lueiuory ];ower is seareely up 1o tin* av(‘ra,uo of 
Ibeir V>’bile Ibis ualive power of seus(‘-ni(auory jdavs an 

iiuportant rob*, it is by no lueaiis tin' only factor in b'aruin;^ to 
s])eir’ (70, IE Gl). 

Abcdsou found tb(‘ fol lowin^j^ eorrcdal ions witb nieniorv for 
words in bis study of SS backward boys and Id liackward 
I 4 :irls: int(U‘ju-ejatiou of incjur<‘s, ])oys 0..‘ai, twirls O.dd ; 
nicanory for siaiteiices, bovs OJiti, ^irls. O.ld; tappiiiiL;'. boys 
-O.OS, j^irls O.dO ; UH'inoiy for coininissions, boys 0..‘IS, ^irls 0..“>t. 

Ib'own t(‘sted seviu'al <>rouikS, mainly ])ui»ils 11 to 12 ytan s (dd. 
and found Ibe folIowin<;- (‘orrelat ions will) bis lest of learnin;^ 
nonsense syllables: eoinpletion best, 0.2S, 0.d>7, 0.b2 ; nuunory 
for ])oetry, 0.d8, 0.10; sja-ed in addition, — 0 . 1 .*>, 0 . 0.27; a<‘(*u- 
racy in addition, — 0.22,, 0, 0.:>1 ; drawing:;, O.dO. 

Hurt's correlations, so far as they a]>j)ly to t(“sis mentioned 
in this work, are displau'd in Table ll*b AVyati's in Table 111. 

Simpson publislu's tin* following; as estimat(xl I riu* corrcda 
tions witb memory for words for laopb* in e;(‘nera] : compbdiou 
t(‘sl, 0.S2 : bard oi)i>osiit‘s, O.Sl; easy o])]»osit(*s, O.G.') ; tbe a test, 
O.ol; memoiw for i)assa^es, O.SO ; adding', 0.2,0. 

In tin* lialf doz(‘n ratbcr \ari(*d ti'sts classed to!L;<‘lbci- b) 
Jl(*ymans and Hiaiginans I In* int(*rcorrelat ions for tbe sc*\(‘ial 
tests raii^'(*d from — 0,21 to boolinj; jot>('tb<*r of 

tbe results of tests classed as tests of in(*mory, ima;^inat ion. (Oi , 
yiebb'd (orrelat ions' of 0.72 between memory and innpeinat ion, 
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TABLE 113 


CorrcJatfoii/i irilli A}naUf(n,ialcd Jiesulls of Immcfliatc Memory Tests 
{After Burt) 


i 

KAW CORRELATIONS 

CORRECTED CORRELATIONS 






! 

1 

Efcm. Sch. 

1 Prep. Sch. 

Elem. Sch. 

Prep. Sch. 

Spot pattern 

.25 

.55 

.41 

1 

! .84 

Jlirror drawing ' 

.08 

.44 

.13 

! .64 

Tapping 1 

.01 

.52 

.01 

; .80 

Pitch discrim | 

.13 

.20 j 

.19 

’ .27 

Lifted weights j 

.05 

.15 j 

.07 

1 — 

! -22 

1 


TABLE 114 


Correlations JU tireen 

Memory Tests and Other Tests 

(After Wyatt) 

1 DELATED MEMORY 

liMKRJDIATE MEMORY 

' LETTLit dVtwARES 

Analogies ■ 

.70 

1 

' .64 

! .28 

Completion i 

.72 

i .61 

! .03 

Word building .j 

.66 

f .57 

: .00 

Part-wholes 

.51 

.52 

1 .09 

Fables | 

.43 

.41 

* .31 

Immediate mom ; 

.71 

; 

; .25 

Letter sciiiares ■ 

,15 

j .25 

k 


TABLE 

115 



Reran of Different Memhers of a 7‘Tcrm Series {Dinct and Henri) 


Place in series 

Times recalled correctly— 


1 1 1 

2 j 

3! 

4 1 

1 

6 i 

7 

■1 ! 

1 1 

139 1 

115 

111 1 

122 j 

117 j 

110 


0.73 between memory and eoneentration, 0.54 belwcon memory 
and intellect. 

(18) Itcpcmlencc on race. From sludics condm ted in several 
Missouri cities Pyle (Ola) concludes that ^‘in rote memory the 
negroes have a much beft<*i' memory for concrete tlian for 
abstract >\'ords, but arc greatly inferior to Avhites in both. 
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(19) Misccllafieous observations, (a) Reproduction in cor- 
rect order is more difficult than mere reproduction; reproduc- 
tion is more difficult than recognition, 

(b) The first and the last terms of a scries are more liable to 
be recalled than are the middle terriis (Table 115). 

(e) In word tests, certain terms are often found to have a 
special reproducibility, evidently by attracting special attention 
in some way. Thus, Binet and Henri found that the word 
pupitre (desk), though in the middle of a series, and hence un- 
favorably placed, was recalled in an unusually large number of 
cases. 

(d) Errors of omission are more common than errors of in- 
sertion or errors of substitution — in word tests with school 
children, 4 times more frccpient (Binet and Ilenri). 

(c) Wissler calls attention to the perseverative tendency 
mentioned by Meuinann and others : thus is evinced by the intro- 
duction, in the recall of a given series, of imj)ressions that liad 
been used in an earlier series. Wissler found this tyj)e of 
error es])ecially common in college seniors and mature aS'’s when 
trying the digit test. Meumann, it will be remembered, consid- 
ered perseveration in the word test as an index of poor intelli- 
gence — when the /8’s knew that no series was like a previous one. 
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TEST 89 


Memory for ideas: ^Logicar memory. — This test differs from 
the preceding tests of memory in two respects: in the first 
place, connected, meaningful material is used instead of a series 
of disparate impressions; in the second place, the reproduction 
that is demanded is primarily a reproduction of ideas, not an 
exact, verbatim reproduction of the original presentation. In 
other words, this test, to use current phraseology, measures 
^logical,^ or ^substance^ memory, instead of h*ote,’ nr bneclianical^ 
memory. 


While, in principle, the attitude taken by S toward the test of memory 
for ideas is distinctly different from that taken toward the test of mem- 
ory for discrete impressions, yet, in practise, it is not always possible to 
differentiate these attitudes in the tests as actually administered. Thus, 
Binet and Henri, and after them. Miss Sharp, conducted tests of “memory 
for sentences/' In these tests, the sentences ranged from short to long, 
and from easy to difficult. A short, easy sentence, e, g., a sentence of 
11 words, is almost invariably interpreted by 5 as a straightforward test 
of verbal memory, and the reproduction is at bottom a recall in verbal 
(mainly auditory verbal ) terms. On the other hand, a long, difficult 
sentence, e. g., a sentence of 8G words, when heard or read but once, 
must be reproduced in substance, not verbatim, and the recall, for most 
JS’s at least, is a recall by meaning, a reproduction of the ‘gist’ of the 
material presented. 

It Is evidently better to keep separate these two different forms of 
memory test, with their two correspondingly different attitudes. Tlie 
material of the present tests is, accordingly, sufficiently lengthy to pre- 
clude verbatim recall. Memory for sentences of progressive length has 
been treated in Test 38. 


The purposes of the test are similar to those of other memory 
tests, viz.; to determine individual differences in memory effi- 
ciency as related to sex, age, training, native ability, etc. As 
in those tests, too, the effect of different methods of presenting 
the material, or of different forms of material, may be studied, 
and immediate may be compared with deferred reproduction. 
The results of the test may also be correlated with the results 
of other tests, particularly with the tests of rote memory just 
described. Among others, the following examples are char- 
acteristic of these various uses of the logical memory test. In 
the Binet-Simon series of 1908 the Stoi^ of the Fire was intro- 
duced at the 8th and 9th years. Wissler used a logical memory 
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(GSt in his series applied to Columbia freshmen, Terman in his 
comparative study of bright and dull boys, Winch in the inves- 
tigation of fatigue and of transfer of training, Simpson in his 
comparison of competent and im ompetent adults. The Marble 
Statue test, which the author derived from Shaw\s study of 
memory in school children, has been applied by Pyle to several 
huiidied cliildren and adults for the purpose of establishing 
age and sex norms. Aall used an anecdote, much longer than 
tliose here {‘rescribed, as tlie material for an interesting study 
of sex and individual dilTerence, j)articularly as atfected by 
immediate^ or deferred reproduction. I'erhaps the most elabo- 
rate investigation of “memory for connected trains of thoughP^ 
is, however, that of Henderson, who administered a series of 
tests to over 200 >S'’s, ranging from 10 year-old 5th-grade chil- 
dren to adult students in the university. Henderson^s work 
forms the basis of the tests which are liere prescribed, with some 
modifications suggested by the use of the test by the author for 
several years as a class exercise. 

Materials. — Watch. Three prinied forms — The Marble 

Statue, Cicero, and The Dutch Homestead. 

The first of these is taken from the appendix of Shaw’s article, and ; 
was api)areiill.y used Iw Idm for subsidiary tests. T'lie vsecond and third 
are Nos. 2 and 4 of the five texts used by Henderson. If E wishes to 
extend the tost by using more ditficult material, he may employ llcnder-, 
son’s No. r> — a selectiou entitled “The Stages In the Develoj)mciit ofv 
nuiiian Hicory,” from Cohite’s Positive Philosophy, If the Marble 
Statue proves too ditlieult or uninteresting for very young S'f^y 'E may 
employ to advantage the text proposed by Ihiict and Simon (Wallin’s 
arrangement) or the story of Mr. Lincoln and the Pig (from (Uyde and 
Wallace, Throuyli the Year, Book 2, Silver, Burdett & Co.). 

Three Houses Burned 

(From the 1908 Binet-Simon tests, revised by Wallin) 

(51 words, 20 ideas) 

New York, j September 5th. ] A fire ] last niglit j burned | 
three houses [ in Water Street, j It took some time | to put it 
out. I The loss | was fifty thousand dollars, | and seventeen 
families | lost their homes. | In saving | a girl j who was 
asleep | in a bed, | a fireman | was burned 1 on the hands. 
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How M«. Lincoln Helped the Pig 
( loi words, 42 ideas) 


^‘Oiic day | Mr. Lincoln | was out riding. | As be passed 
along the road, | be saw a pig | sinking | into a iiiiid-bole. ! 
Poor I piggy would climb | prad way | up the sU^ipery | bank, | 
Iben down be would fall again. | 

M supj)Ose I sboiild get down | an-d help ] that ])ig,' | Ibougbt 
^^r. Lincoln. ^l>ul I have on my new suit, | and it will be cpiile 
spoiled if I do so. j I think Pll let him ge; out | the best way 
be can.’ | 

He rode on. | When nearly | two | miles away, | be turned | 
and came back. | Not minding the new ] clothes, | be stooped, |.. 
and taking piggy in bis arms, | lie dragged bini | out | of the 
mud. [ 

The new' | suit | W'as quite | spoiled, | but Mr. Liin oln | said 1 
be bad taken a pain | out of bis mind.” | 

.Method. — Provide S w'itli ])aper and pencil. Ex[)laiii tlui 
nature of the test, as follow's: ‘‘I am going to read you some- 
thing to see bow wxdl you can remember it afterward. You 
must pay careful attention, as I shall read it but once. As 
soon as I have fniisbed, take your ])encil and write as 
iiim li of the story as you can remember. Jf you can remember 
it in just the w ords you beard, use those words, but if you can’t 
do that, tell in your own words, as w^ll as you can, wdiat it w as 
that I read to you.” 

Read the })assage, including the title, with most careful 
enunciation, and wdth proper attention to expression. The rate 
of reading should be somewhat slower than in ordinary read- 
ing — say a full minute for the Cicero test. Allow' S amjde 
time for w'riting, then ask him to underline each word in bis 
rejmoduction that be feels sure is exactly the same as the 
Original passage.^ 

^i'^Tbis tost lends itself easily to the proiip method. Tlio usual iirocau- 
should be taken to avoid disturbance and commiiiiication. /; may 



fgiave himself much labor by asking ca(‘I) N to count the total inini!)or of 
^''Urds he has written, then the total number of words he has underlined. 
tVHb mature ^*s, E may also reread very slowly the original text, and 
tltt;iach N check up the total number of ideas c*orrectly reprodiictHl, i. c.. 


r<^:«sented, whether verbatim or by equivalent phrases, in his rei)rodue- 
1^. The division of each text into its constituent ‘ideas’ is indicated 
&Iow. 
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Variations of Method. — (1) Supply S with the printed text. 
Inform him that he is to have 2 min. to read the passage. As- 
sure him that this time is ample to read it over carefully more 
than once. Direct him to read the passage straight through 
twice, and thou use any time that remains in studying it as he 
wishes. 

(2) Defer the reproduction to any desired time after the 
reading, e. g., 10 min., 24 hours, 1 week, 4 weeks. Or require 
an immediate reproduction, followed later, at one or more of 
the intervals just suggested, by a second or by a third reproduc- 
tion.2 Conduct these deferred trials in the same manner, as 
far as directions to underline, etc., are concerned, as in the 
first trial. 

Treatment of Data. — The simplest plan for scoring the data 
of this test is that used by Terman and by Wissler, who merely 
graded the papers on a scale of 5 (or of 10) for a perfect re 
production — perfect in the sense of a reproduction of all the 
ideas of the original text, whether in terms identical with, or 
merely equivalent to, the original. 

For ordinary purposes, the author has found it serviceable to 
score the papers for the following points: (1) number of words 
written, (2) number of words underlined, (3) percentage of 
underlined words that are correctly underlined, (4) number of 
ideas (‘details^ in Henderson’s terminology) that have been 
reproduced, whether exactly or in equivalent phrases. To 
these may be added, if desired, (5) number of ideas wrongly 
inserted. If but a single score is to be made, the fourth is 
obviously the one to be used, since the task assigned to 8 is to 
give as many as possible of the ideas of the text.^ 

The second and subsequent reproductions are scored in the 
same manner as the first. Retention is then measured, follow- 


*It is better, on the whole, to give no intimation of the intent to demand 
a second reproduction. Some -S?’s may compare notes after the first 
reproduction, but if the subsequent trial Is announced beforehand, 
coupled, as !t ought to be, with the request not to think of the test in 
the Interim, the request is more apt to work as a counter-suggestion, so 
that many 5’s will test their recall of the passage, and otherwise furbish 
up the memories during the interval. 

“Consult Aall, Sharp or Henderson for more elaborate methods of treat*^ 
ing data, particularly for devices for qualitative analysis. 
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ing Shaw and Henderson, bj computing the percentage of loss 
between these and the first reproduction. Occasional cases of 
improvement in the later reproductions are rated as a negative 
loss. 

To ascertain the ^idea-score,’ S’s reproduction must be com- 
pared, step by step, with the standard divisions of the original 
text into ideas.^ 


The Marbue Statue 
(1G6 words, G7 ideas) 

A young | man [ worked [ years ( to carve | a white | marble j 
statue I of a beautiful | girl. | She grew prettier ( day by day. | 
He began to love the statue ( so well that | one day [ he said to 
it : I ‘T would give ( everything | in the world | if you would be 
alive I and be my wife.” ( Just then | the clock struck | twelve,! 
and the cold j stone began to grow’ w^arm, | the cheeks red, | the 
hair browTi, j the lips to move. ( She vstepped dow’n, j and he 
had his w ish. | They lived happily ( together | for years, j and 
three | beautiful | children w^ere born. | One day | he was very 
tired, | and grew^ | so angry, | w'ithout cause, j that he struck her. | 
She wept, | kissed j each child | and her husband, | stepped 
back I upon the pedestal, | and slowly | grew^ cold, | pale j and 
stiff, I closed her eyes, j and w’hen the clock j struck j midnight,! 
she was a statue | of pure ( w^hite ( marble | as she had been | 
years before, | and could not hear \ the sobs | of her husband | 
and children. 


Cicero 

(125 words, 64 ideas) 

^^Cicero, | the greatest | of the Roman j orators, j was born j 
at Arpinuni, | an obscure | country | town. | His family j was 
of the middle class | only, j and without w^ealth, | yet he rose \ 
rapidly j through the ranks | of Roman | official service j until 
at the age ( of forty-six j he became | consul. [ In oratory j be 

*The scoring for ideas for these three passages is taken, with a few 
minor changes, from Shaw and from Henderson. For a division of the 
second and third texts into topics and sub-topics as well as into ideas, 
the reader may consult Henderson (6, pp. 29-30). 
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is I by universal consent 1 placed side by side' 1 with Demos- 
thenes, I or at least | close after him. | He surpassed [ the 
great | Attic j orator | in brilliancy | and variety, ] but lacked j 
his moral | earnestness [ and consequent | impressiveness. | 
He could be | humorous, | sarcastic, | pathetic, | ironical, | 
satirical, | and when he was malignant | his moutli was | most | 
foul I and his bite | most | venomous, j His delivery | was im- 
passioned I and fiery, | his voice | strong, | full, | and sweet, \ 
his figure | tall, | graceful, | and impressive.” 

The Dutch Homestead 
(180 words, 94 ideas) 

^^It was I one ] of those spacious | farm- ] houses, | with high- j 
ridged, ] but lo\\iy | sloping | roofs, | built | in the style | 
handed down from | the first | Dutch | settlers, | the low j pro- 
jecting I eaves | forming a piazza | along the front | capable j 
of being closed up | in bad weather. | Under this | were hung 1 
flails, I harness, [ various | utensils | of husbandry, | and nets | 
for fishing | in the neighboring | river. | Benches ] were built | 
along the side | for summer use; | and a great | spinning wheel I 
at one end, | and a churn | at the other, | showed j the various | 
uses I to which this | important | porch | miglit be devoted. | 
From this piazza | one might enter | the hall, | which formed | 
the center | of the mansion | and the usual | place of residence. | 
Here | rows | of resplendent | i)ewter | ranged ] on a long ] 
dresser [ dazzled | his eyes. | In one corner | stood a huge | 
bag I of wool, I ready | to be spun; | in another | a (piantity | of 
linsey-woolsey, | just | from the loom; ] ears | of Indian | corn | 
and strings | of dried | apples | and peaches | hung | in gay [ 
festoons I along. the walls, | mingled | with the gaud | of red ; 
peppers.” 

Results. — (1) Aorms. Performance with the Marble Statue 
selection has been investigated by Pyle (grouj) method, written 
reproduction) with the results shown in Table 110. The au- 
thor^s i^esults for college students with the Dutch Homestead 
selection are shown in Table 117, while some idea of the dis- 
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tribution of performance for the Cicero selection with college 
students (mostly Sophomores) is given by Table 113- In all 
of these tables, and iiarticularly m those referring to- college 
students, evidence is given to show the unexpectedly large in- 
dividual variation in memory for ideas that prevails even 
with’.n a group of S’s of ai)parently similar attainments. 

TABLE IIG 


Marhlc Statue Test, Scores 7>2; Age a d Sex (Pyle) 


sex 



9 

10 I 11 1 12 j 13 I 14 1 15 1 10 i 17 

1 ] 1 1 1 1 1 

18 j 

ADULT 


Cases 

102 

148' 

" i i 1 1 1 1 I 

142 149 1.50 103 T29i 89 |t!0 i45 

32 

65 

Male 

Aver 

24.328.7 

30.0 32.9 35.1 3G,8 S6.1 biy.o 34.4 34.G 36.9 

3S.3 


A. D. 

6.7 

9.1 

6.7 j 5.6 7.4 6.3| 7.0| G.7| 5.6; 8.7 

6.0 

7.0 


Cases 

89 

CO 

lO 

-f— t 

138 156 191:104 il46 '99 'i94 'ifal 

48 

86 

Female. 

Aver 

28.5 31.0 33.5 -36.4 38.1 38.5 39.0 S9.1 37.3 3G.6 

07 0 
u i -0 

i 40.1 


A. D 

! 

11.3 

9.4 

6.8 7.7 7.2 7.1| 7.5 6.3; 5.1 1 G.O 

4.4 

j 5.9 


TABLE 117 

Dutch Homestead Test, Words Written and Underlined (Whipple) 



FIRST TRIAL, 

NO INTERVAL 

SreOND TRIAL, 24 HOURS 

latkr 

Total Words 

Words Under- 
lined 

Total Words 

Words Under- 
lined 

Average, 9 men 

80,4 

48.0 i 

83.0 

88.4 

Average, 22 women..„ 

95.5 

38.8 

99.G 

34.1 

Maximal records 

127.0 

102.0 ' 

138.0 j 

66.0 

Minimal records.. 

45.0 

4.0 

52.0 

i 


TABLE 118 

Cicero Test, Distribution of 36 College Students (Whipple) 



BEST SIX ; 

1 

1 2d six 

3d six 

4th Six 

5th six 

WORST SIX 

Words written™ 
Correct idc^s 

115% 

46-37 

9588 

35^34 

1 

84-75 i 
3228 

74-6G 
! 28-25 

1 

G5-G0 

25-21 

56-25 

20-7 
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(2) Dependence on age, Binet and Simon put the reproduc- 
tion of 2 items from the Story of the Fire as standard for 8 
years, G items as standard for 9 years. The results reported 
by Vos, ^Yho read to boys and girls 9 to 14 years old a story 
(‘ontainiiig 10 ‘ideas' and called for reproductions 3 days later, 
show rather unusual variations from year to year, despite the 
fact that some SOU >S''s are re]u*esented : report is declared to be 
good at 9, best af 10, thence deteriorating decidedly to 13, but 
iniju’oving at 1 1 years. The elaborate studies of Shaw and of 
Henderson is re also somewhat difficult to interpret. It appears 
evident, howevin*, that a distimOion must be made between 
elliciency in the first re])roduction and efficiency in subsequent 
reproductions. If the first bo termed learning capacity, and the 
second retentive ca]»acity, and if the latter be measured in 
terms of the jiroportion of the first reproduction that is retaineit 
in the second (or later) reiu'oduction, then adults may be 
shown to surpass children in learning capacity, but not in 
ri'tentive caiiacity. 

Thus, in Shaw's rather difficult 324*word story, the learning 
capadty of boys increased, from the 3d to the 9th grad(% from 
17 to 12 p(‘r cent., that of girls from 18 to 43 ])er iiait. ^ligh- 
S( hool boys av(‘rag('d only 10 jier (*ent., high-schoed girls about 
17 per (cnt. Shaw's university students did no better, while 
Henderson's summer session students were inferior to his 15 
and IG-year old school children. In short, then, logical, like 
rote memory appears, when measured by the first reproduction, 
to be at its best near puberty. This conclusion agrees entirely 
with the averages secured by Pyle for children 8 to 18 years 
old and for adults (Table IIG). His boys reached their maxi- 
mal ability at 13, his girls at 12 years. 


TABLE 119 

Average Percentage of Loss in Third Reproduction (After* 4 Weeks) 

(Henderson) 


AGG 

1 ADULTS 

16 

15 

14 

13 

12 

11 

10 

Percentage of loss 

14 

8 

13 

15 

14 

12 

10 

10 
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Turning to the later reproductions, Shaw and Henderson 
(Table 119) agree that younger S^s have as good retentive 
capacity as do adults. 

(8) differences in this test, as in the rote-memory test, 
are in favor of girls. The difference is indicated clearly in the 
author’s data for college students (Table 117), and similar, 
differences are reported by Shaw, who found the growth of 
memory for ideas to be faster in girls th^n in boys, and the 
average performance of girls to be some 4 per cent, better than 
that of boyfe. Wissler’s records for Columbia freshmen show 
an average of 44.5 per cent., P.E. 11.1, for men, and 48.2 per 
cent., P.E. 13.2, for women. Pyle's averages reveal the supe- 
riority of girls at every age from 8 to maturity. Schramm’s 
comparison of 16 men and 16 women (students at. Freiburg 
University) shows a slight superiority for the women, though 
the differences do not exceed their i)robable error. The only 
exceptions to this trend in favor of sup(U*iority of females seem 
to appear in the work of Vos and of Aall. The latter states 
that the reproductions of women are usually fuller, but those 
of men are more compact, hneatier,’ and betray greater plastic 
power, greater originality in formulation. 

(4) Dependence on time-interval. The insertion of a time- 
interval between presentation and reproduction has much less 
effect upon memory for ideas than upon memory for discrete 
impressions. Table 117 shows that, if a second reproduction 
is called for one day after the first, the average ^ actually 
writes more words. The words in the later reproduction are, 
however, less exapt copies of the original text, and there is a 
tendency to insert extraneous material, so that fewer words 
are underlined, and there is a slight net reduction in the num- 
ber of ideas reproduced. In the author’s tests, this reduction 
was but 3 per cent, at the end of one week. , Table 119 shows 
that an interval of 4 weeks produces a loss of but 8 to 15 per 
cent. 

Similar conclusions are reached by Aall, who compared the 
reproductions of a lengthy story directly after hearing it and 48 
haurs later. The latter reports were on the whole poorer — ^more 
omissions and more ^falsification.^ They are shown to ^lean’ 
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strongly on the first reports, often to become more verbose and 
less precise, and sometimes matters that were correctly left 
I'ialher vague in the first report become erroneously iogicizcd^ 
into explicit and particularized statements, which are actually 
possible, but in<‘orrect as reports. On the other hand, as Aall 
j>oints out, there exists a sort of ^after inemory^ such that cer- 
tain details which are forgotten or at least unmentioned in the 
immediate reproduction come to light correctly in the delayed 
one. The induence of time-interval also api)ears to oper- 
ate dilferently on different forms of material; for instance, 
names of j)laces are lost sooner than memories of objects. 

It is a matter of special interest to note that the relative 
standing of aS's remains ]>ractically the same in tests conducted 
with immediate, and with deferred recall. Similarly, those 
who memorize a })assage of a given length in quick time are not 
found to be at a disadvantage in subsequent recall (see Ogden 
and I*yle, 12), though the individual ditferences are usually 
found to be less in subsequent recall than in original speed of 
learning. It follows that, so far as this test goes at leasl, the 
pojmlar notion “easy come, easy go” is not borne out by ox])e- 
riniental evidence. Henderson found that this correlation 
between learning capacity and retentive capacity was brought 
out better in scoring for ideas than in scoring for words. 

(5) Dependence on method of present ation. When a single 
hearing is compared with reading done by >8 (3 min.), the for- 
mer is found to be nearly as good as the latter for immediate 
reproduction, but the latter to be much more effective than the 
former for deferred reproduction. 

(6) Dcpendci\ee on practise, Baade, who scored the reports 
made by lOG girls, aged 12-13 years, u])on what was said by an 
instrmdor in the course of a series of demonstrations in ])hysics. 
found that under those conditions there was no demonstrable 
improvement in their work, either from the suc(‘ession of the 
three sets of demonstrations or from the re])etition of the 
demonstrations. Nevertheless, the work of other investigators 
gives little doubt that practise will improve memory for ideas, 
as it will improve nearly every form of psycho])hysical activity. 
Special training thus accounts, in all probability, for the high 
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scores (52 as over against 40 to 47 per cent.) reached by the 
pupils of Miss Aiken^s school® in comparison with the work of 
Worcester high-school children. ^ 

Winch (21) has investigated the possibility of transfer of 
practise, and concludes that “improvement through practise 
ill rote memory for things with and witiioiit meaning is fol- 
lowed by improvement in substance for st^riesd^ He argues 
that this transfer may take place despite the circumstance that 
correlations between rote pnd substance memory are some- 
times, as in his own work, of a low or even uoubtful character. 
Winch (23) has also investigated the transfer of practise in 
substance memory to eflSciency in productive imagination. He 
concludes that ^‘children practised in substance memory for 
stories become thereby more proficient in the invention of 
stories. The improvement is not due to the insertion of parts 
of the content of the memorized stories wdthin the invented 
stories, but to some community of function less atomistic.’^ 
An exception apj)eared, however, in portions of his experi- 
mental work, whi(‘h leads him to add that “children practised 
in substance memory up to the fatigue point, which is taken 
here to mean the point at which consecut-ive exercises cease to 
produce improvement, are thereby prejudicially affected so 
far as their power to invent stories is concerned.” These 
Tatigue-etfects,' he says, “appear to be temporary, whilst prac- 
tise effect (improvement through practise) appears to have 
considerable duration.” 

(7) Dependence on fatigue. Although it is generally con- 
ceded that one of the commoner symptoms of mental fatigue 
is slowness or uncertaintj’ of recall of ideas, no one but Winch 
(22) appears to have used the logical memory test in this con- 
nection. Winches test was limited to a group of boys who were 
studying at an evening school. They were given 10 minutes to 
memorize the substance of passages of some 150 words and 
tested by the method of equivalent groups at 9 and at about 
9.30 P. ^r., with the result that some 28 per cent, of difference 
was revealed. Since tests in day schools had shown prac- 

®For an account of the special training given to .Miss Aiken’s pupils, 
see Test 25 and references thereto. 
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tically no difference between children working at noon and at 
4.30 P. M., Winch argues that children who take evening school 
work after a day^s work at various occupations exhibit a very 
rapid and pronounced susceptibility to mental fatigue. 

(8) Dependence on length of text. The number of words re- 
produced after one hearing increases, though not in direct pro- 
portion, wijh the length of the passage heard (Binet and 
Henri). 

(9) Dependence on portion of text. If the original passage 
be divided into Sds or 4ths (or even, if long, into 8ths), it will 
be found that, on the average, the reproduction of any one of 
these portions is inferior to the one that precedes it and supe- 
rior to the one that follows it. Thus, Shaw'S story, on division 
into 4 parts, was found to be reproduced in the amounts 52, 
34, 31, and 28 per cent., respectively. 

What may be regarded as a test of logical memory was made 
by Dell with 30 boys who listened io an hoiir-and a-half lecture 
upon material in Punch, which was illustrated by 80 lantern 
slides. The boys were asked 8 days later to indicate which 
slides they recalled. The first 15 slides were, on the average, 
i*ecalled by 11.2 boys, slides 47-5t) by 3*8, slides 60-74 by 3.5, 
and slides 75-80 by 4.8 boys. These figures certainly seem to 
demonstrate a decidedly better recall of slides in the first por- 
tion of the lecture, with a questionable slight nae at the end of 
the lecture. Dell, however, believes that there were at work 
other causes than simply the dependency of memory on different 
positions in the lecture. 

(10) Reliahility. The work of Simpson, Winch and others 
shows that the logical memory test has an acceptable degree 
| 0 f reliability. Winch^ obtained coefficients of 0.65 and 0.68, 
between single trials; Sim]>son, coefficients of 0.78, 0.83 and 0.90 
(for different groups) between scores in his first two and his 
last two trials. It follows that the amalgamated results from 
two, or at most three trials of this test afford quite reliable indi- 
cations of' ability in the capacities tested. 

(11) Dependence on ^In telligence. The relation between logi- 
cal memory and intelligence has been studied mainly by rating 
intelligence on the basis of scholarship. The resulting correla- 
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tions are somewhat unexpectedly low. Thus, in 86 cases, Wis- 
sler found a correlation of only 0.19 with class standing, of 0.11 
with standing in mathematics, and of 0.22 with standing in 
Ijatin. Henderson found but a slight correlation with class 
standing in the lower grades, but a closer correlation in the 
higher grades. He is of the opinion thai, at least in the lower 
grades, the school marks put a premium upon industry and 
good conduct, rather than upon native ability, and thus obscure 
the existing correlation. Pyle estimates the relation with class 
standing in college at about 0.30, and says : “If a slow learner 
has the habit of going over a lesson or task several times, and 
a fast learner the habit of giving a lesson but one hasty read- 
ing, other things being equal, the slow learner will have the 
better scholarship’' (12, j). 319). The very best students have 
both good memory and good habits of study. If performance 
in tests of reasoning be taken as a measure of intelligence, 
then Pederson’s work confirms (he general statement given 
above, for of 80 siudents classed as good in reasoning, 20 ranked 
good, 5 medium and 5 poor in memory, while of the 17 classed 
as q)Oor in reasoning 3 ranked good, G medium and 8 poor in 
memory. Again, in Bim]>son\s investigation the correlation 
between logi(al memory and estimated intelligence of his 
^good' grouj) was but 0.35, after correction for attenuation. 
However, his good and his poor group were fairly well sepa- 
raled by (he test, since none of the ])oor group reached the 
median of ihe good grou]) and only 15 per cent, of the poor 
group excelled the lov.est 12 ])er cent, of the good group. 

(12) 5Irntal (hfccfircs, Wallin tested e]>ileptics by means 
of Bim i’s Story of the Fire, thougli Avithout Avaruing them 
Avhen reading lliat a reprodin tion Avoyld be called for. Tabic 

TABLE 120 

Start/ of fJiC Fire, Scores for Epileptics hp Mental Age (After Wallin) 


BINET-SIMON AGE | VU j VIII | IX | X | 

Cases I 13 I 42 ! 27 1 70 28 I U 17 

Aver. Trleos 2.1 1 3.7 j 4.8 5.3 6.5 | 6.8 7.4 
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120 shows the average number of ideas reproduced by his 
patients as classified for mental age by the Binet-Simon tests. 
II is evident that there exists a general progress in efiiciency 
with mental age, but that the average performance of these 
mental defccMves is not as good as would be expected of normal 
children in the ages from 0 to 13. 

(13) MiHcclIancous correlations, Peterson, by the method 
<tf unlike signs, using the jK)oled results of several tests of ea(‘h 
‘function/ concluded that nuunory was correlaliMl with reason- 
ing by 0.40, with abstract thought by 0.G4; with generalizing 
ability by 0.40 and with accuracy by 0.31. Siinj)Son publishes 
as estimated true correlations (holding for ])eo[)le in g(meral) 
with memory for passages the following: completion test 0.71, 
hard o])posites 0.70, nieinory for words 0.80, easy opj)Osites 
0.50, a-test 0.40, adding 0.42. The high correlation with memory 
for words permits us, he comdiides, to class snbstam‘e memory 
with it as virtually the sanu^ capaedty. Winch found (*orrela- 
tions l)(dwe(*n substance memory and ])rodn('t iv(‘ imagination 
(iinc'uting stories) Avhich apjiear to be higher in the more [mo- 
tic icnit classes (the r's secured in various classes were 0.28, 
0.43, 0.48, 0.02, 0.75). Heymans and Brngmans found a (*or- 
relation of only 0.08 between reprodindion of a somewhat 
elaborate story at various time-intervals and the h'arning of 
nonsense syllables, but a correlation of 0.55 between the memory 
test and a test involving memory for details of a pi('{ure. They 
also r('j:ort a ('orrelation of 0.50 h(dw(H‘n the com})letion test 
and ^\ ritten re])roduction of a dilficnlt passage from llotTding\s 
Ethics. 'Wissler found a correlation of 0.21 between logical 
memory and length of head, but no correlation between logical 
memory and rote memory, s])eed of naming colors, reaction 
time, or breadth of head. 

(14) Qualifalire aspeds.^ Tns})ection of the work of children 
and introspective examination by adults of their own mental 

'’Consult ^spoolally nnlabnn, MIchotto and Ransy, niul ^Sflcliotte and 
Porfydi for rurtbor study of the qnalitntlvo as])0(‘ta of ]oi;lcal inoniory, 
particularly of tlie dilTeronce between niecbanical aud lo^jical memory 
inr.ler siupde test condUions, like the method of rl«:lit associates. The 
work of Anil has also numerous susTfrestlve features In addition io those 
here mentioned. 



TEST 39 : MEMORY FOR IDEAS 


[585] 219 


processes reveal a number of interesting principles. In the 
first place, there is a process of selection wovds or ideas that 
are logically or psychologically important and best retained. ' 
Or, as Henderson expresses it, there is, especially during a long 
time-interval, a process of condensation and gent..n^ization. 
The main ideas, the important topics, the brunt of the passage 
may remain fairly constant, but the minor details tend to be 
forgotten, and the original phrasing to become less and less 
clear. 

When, then, the reproduction is demaiided, most first 
recall these main ideas or larger topics, and then develop the 
details, as best tliey may, from them. There is a strong tend- 
ency, in this filling out of the details, toward what Ilinet and 
Ileiiri speak of as ‘S'erbal assimilation,” /. c., a tendcany to 
express the ideas in one's own terms, rather than in those em- 
ployed in the original passage. Thus, adults often use syno- 
nyms or other forms of substitution, while children replace the 
words of the original by words from tina’r ordinary vocabulary 
(e. [},, phnjed for annificd ihansidves, fire for confJofjration) . 
and at the same time tend to simplify the syntax. In general, 
Binet and IJeiiri found tliat the numbcj* of tinacs that synonyms 
arc used in the recall is, in short jtassages great(‘r, and in long 
passages less than the number of ideas eompletely omitted. 

Filially, the substitution of terms for those of the original 
tends, especially in younger aV's and with longer time-intervals, 
to become inexact; in other vcords, the sense of the original 
becomes more or less distorted. Thus, for instance, Binet and 
Henri discovered that, in all sentences containing more than 
20 words,, more than half of their S's had made some change in 
the meaning of the original. Of these alterations of sense, the 
most conspicuous are: (1) change of proper names or of num- 
bers, (2) replacement ot an object by an analogous object that 
might fit the sentence equally well, (3) insertion of details not 
inconsistent with the original, but still not in the original, and 
(4) alterations apparently due to emotional iTaetion, espe- 
cially to exaggeration, c. <7., a frightful snake for a snake, 

Aall thinks that two sorts of can be distinguished — the 
‘reporters,’ who make every effort to get Ibe reproduction ex 
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act, and the ‘describers,’ who introduce various modifications 
and embellishments for the sake of literary or rhetorical eflTect. 
He found the typical error in recounting a story to be omission 
leather than falsification. Mention has been made already of 
the changes found by Aall in deferred rex)roductions. 

(15) Miscellaneous points. In the case of college students, 
from 50 to 90 per cent, of the words underlined are actually 
correct. A certain type of may be recognized, who is ex- 
tremely cautious about underlining words, but who usually 
has these few nearly all correct. 

Binet and Henri estimate that memory for connected seii" 
fences is approximately 25 times as good as memory for discrete 
terms. 
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CHAPTER X 


Tests of Suggestibility 

The term ^suggestion’ has found different usages in psychol- 
ogy ; four at least may be readily distinguished. (1) Suggestion 
is equivalent to association, e. ‘g„ the idea 'hoi^e’ suggests the 
idea ^Black Beauty.’ (2) Suggestion is the conveyance of an 
idea by hint, intimation, or insinuation, c. g,, the orator suggests 
an idea by an appropriate gesture. (3) Suggestion is a method 
of creating and controlling hypnosis. (4) Suggestion is a 
process of creating belief or affecting judgment, usually an 
erroneous belief or false judgment, in the normal consciousness. 
Here emphasis is placed upon uncritical acceptance of a notion 
usually with the implication that the suggested individual 
is unaware that his ideas have been thus affected. From his 
point of view, suggestion is, then, to follow Stern’s definition 
(6), “the imitative assumption of a mental attitude under the 
illusion of assuming it spontaneously.” 

The tests which follow all purport to measure susceptibility 
to suggestion in this last-named sense. In them, the experi- 
menter seeks, by suitable arrangement of the test-material or 
of the instructions, to induce the subject to judge otherwise 
than he naturally would — to induce him, for example, to judge 
equal lines or equal weights to be unequal, or to perceive 
wmrmth when there is no warmth, etc. If the attempt is suc- 
cessful, the subject is said to have ^yielded,’ or to have ‘accepted’ 
the suggestion ; if unsuccessful, he is said to have ‘resisted’ the 
suggestion. The degree of his suggestibility^ is indicated by the 
quickness or frequency of his ‘yields.’ 

Just as efficiency in observation, attention, memory, and the 
like has been shown to be specific, not general, in character, 
so is it probable that suggestibility is specific, not general, in 
character. For this reason, suggestibility must be tested by 
more than one method. 
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Many of the tests in other portions of this book, e. Nos. 
J7, 23, and especially 32, afford opportunity for noting the sug- 
gestibility of subjects. The serial graded tests of Binet and 
Simon also contain directions for testing the suggestibility of 
young or of feeble-minded children. 

The tests which follow deal with suggestibility aroused by 
the volume-weight illusion, the length o lines, judgments of 
weights under special conditions, and illusory warmth. Other 
ex]feriment.il im^thods of inducing suggestibility, which have 
not as yet been arranged tor test work, may be briefly cited. 

11. J. Peaire (3) had ^S'’s sit in a chair with a circle of 3.5 ft. 
radius drawn about it. ^ fixated a small bit of pajier directly 
in front of him. A test sijuare was ex])osed briefly at a i)oint 
somewhere to the right of the hxatiun-poiiit, and aS’ located its 
position aftia ward by moving bis eyes to the i*ight. Suggestion 
was introduced by displaying at times a third bit of paper near 
oj* fartlH*r tliau the test S(|uar(\ There was at first a tendeney 
to resist this suggestion, but eventually there was developed a 
tendeney to locate the test square iu a direction corresponding 
to tlie location of the suggestive paper. Auditory and tactual 
stimuli were also tried. 

J. C. Bell (1) displayed triangles of different shat)es and 
heights, also vertical distances between points or between a 
])oint and a line. The *S’’s re})roduccd the distances and were 
given verbal suggestions or visual suggestions to ‘^make liiglf^ 
or ‘hnake low,’^ etc. In general, the suggestions did affect the 
test with triangles, but there were dccidul individual differ- 
ences, and in many casts the const ant errors were gn^afer than 
the eirors indiu'ed by suggestion. 

The woi'k of E. K Strong (7) was similar in chaiander. save 
that his aS’s exerted maximal strength of grip while exposed to 
such suggestions as '‘Now yon ean make it stronger than usual,” 
ete., but with tlie proviso not voluntarily to interfere with the 
suggestion. The results showed that grij)s following both sug- 
gestions of Sveak' and 'strong' were stronger than those in- 
tended 1o ])rodiiee 'neutral,’ while there was no difference b( 
tween two first kinds. 
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W. D. Scott (5) produced suggestion with some success by 
inducing ;8f^s to think that the flight of colors following an 
exposure to white light corresponded in order to the arrange- 
ment of colors in the spectrum. 

Inez Powelson and M. F. Washburn (4) showed colors with 
comments upon them, such as ‘delicate/ ^crude/ etc., and in- 
fluenced in this way the affective reactions of 19 ^’s, but failed 
with 16 others. 

Giroud (2) showed M children, aged 7 to 12 years, a series 
of 10 colors, with the instructions to name each color and then, 
when the color was withdrawn, to write the name. At the 3d. 
7th and 10th terms, a wrong color-name was uttered by the ex- 
perimenter to try to induce ^ to write it. The average number 
of ^yields^ was reduced gradually from 2.8 at 7 ytnirs to 1.7 at 
12 years. 
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TEST 40 

Suggestion by the size-weight inusion.—Big things .are ordi- 
narily he.nvier Ilian small things of the same kind. When we 
lift two weights of apparently the same material, but of differ- 
ent sizes, we more or less unconsciously put forth more energy 
or expect to meet with more resistance in lifting the larger. If, 
as in the case of the so-called ‘suggestion-blocks,’ the weights 
are really the same, we almost inevitably judge the larger 
weight to be the lighter; in other words, the visual appearance 
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of the weight has given us a suggestion— or, as it turns out, 
rather, a disappointed suggestion — of weight.^ 

This error of judgment is undoubtedly due to an association 
built up by long experience in handling and lifting various 
^articles and objc( ts.- One might, therefore, suppose that 
younger children, or less intelligent children, who would, pre- 
siiniably, have had less of this discriminative association of size 
and weight, would be less affected by the suggestion. For this 
reason, the size-weight test has been applied by several investi- 
gators to determine or lo measure, at least relatively, the degree 
of suggeslibility exhibited by school children under various 
conditions. iUit it is to be noted that the having of the illusion 
is normal, so that this lest is not on the same order as those 
that follow it, and it has probably no particular value as a 
measure of suggestibility in older children and adults; its 
primary value lies in its use with young or mentally defective 
children. 

Appahatus. — L ow table. 8oft black cloth. Set of ^sugges- 
tion-blocks,’ patterned after Gilbert, but modified by extending 
the comjiarison series in both directions. 

'This set consists of two standard blocks and 20 comparison blocks. 
Doth standards weigh 55 grams; both are 28 mm. thick, but the larger is 
82 and the smaller 22 mm. in diameter. Tlie 20 comparison blocks are all 
28 mm. thick and 35 nun. in diameter, but llieir weights range from 5 to 
100 g. by 5 g. increments.^ All are painted dead black. 

If it is desired merely to make a quick determination of the presence 
or absence of the illusion, simpler material may be employed, preferably 
the ‘Demoor blocks’ as used at the Vineland (N. ,T.) Training School. 
Those blocks are of poplar wood, and both weigh 1.5 lbs. ; the one is l,75x 
3x1 in., the otlier 1.75x1x12 in. They are set before S with the simple 
instruction : “Tell me wbmh block seems the heavier.” 

Method. — Arrange the table at such a height that fore* 

hVs Scripture remarks, the poor fellow v ho has been laughed at for cen- 
turies for saying that a pound of lead is heavier than a pound of feathers 
is perfectly right, so long as. he speaks psychologically, and looks at the 
pillow and the bit of lead pipe. A concrete demonstration of the truth of 
this statement is afforded by several experiments reported by Wolfe. 

^Some writers, however, c. g., Flournoy, attribute the illusion to an In- 
born nervous connection. For a discussion of the psychological factors 
concerned In this experiment, particularly in its relation to the Tnnerva- 
tion-sense,’ consult Flournoy, Muller and Schumann, Seashore, Bolton, 
Loomis, and van Biervliet. 

^Gilbert’s mparison blocks were but 14 in number, with a range from 
15 to 80 g. This range proved inadequate for younger S'b. 
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arm will be parallel with the floor when lifting a weight. 
Spread over the table the black cloth, which should be large 
enough to cover at least the portion of the table occupied by the 
weights, and thick enough to deaden the sounds incident to 
their replacement. 

Arrange the twenty comparison blocks on the cloth, in the 
order of their weight from left to right, and in such a manner 
that any one of them may be reached by S without materially 
changing the angle of his arm. Place before S the larger stand- 
ard block, and say: ^‘Here is a block. I want you to find a 
block in this series of 20 blocks that seems to you just as heavy 
as this one. Lift it by picking it up edgewise with your thumb 
and finger, like this. [Illustrate.] Then try the first of these 
weights [at the left]. If that doesn^t suit, try the next, then 
the third, and so on, till you find a block that seems equal to 
this one. Each time you must lift this block first, then the one 
you are trying in the series. Keep your eyes constantly directed 
at the weight you are lifting.^^ When S has selected an equiva- 
lent weight, the same procedure is followed with the second, or 
smaller, standard block. 

The work ol’ investigators in the psychological laboratory, particularly 
Martin and Miiller, and Miiller and Schiunann, has shown that our esti- 
mate of the absolute or relative weight of a body is conditioned by an un- 
Buspectedly largo number of factors, so that, while it may be true, as 
Fourclie (8) assorts, that voluntary nioditieations in the speed of grasp- 
ing and lifting the weights do not modify the size-weight illusion, it seems 
desiral)le liiat the eoiulUions under which 8 lifts the blocks should be 
kept as uniform as i>ossible. 

8 should pick up each block in the same manner, lift it at the same 
tempo and to the same height Again, since the memory image for weight 
changes rapidly, 8's judgment, in so far as it is based upon the image of 
the first weight, would be appreciably altered if the second weight were 
lifted at varying intervals after the first : the interval should, accord- 
ingly, be made as constant as possible, and fairly short, say not over 3 
sec., and the arrangement of the weights must be such as to permit this 
proceilure. Finally, in this test, since the suggestion hinges upon Ihe 
visual [lerception of the block, E must be sure that ^ looks directly at each 
block as he lifts it. 

Treatment of Data. — Following Gilbert, Scripture, and Sea- 
shore, the force of suggestion produced by the difference in size 
of the two standard blocks may be indicated by the difference 
in weight, in grams, between the tw^o comparison blocks that 
are selected by S as the equivalents of the two standards. 



TEST 40: SIZE-WEIGHT ILLUSION 


[593] 227 


The force of the size-weight illusion has been expressed by 
Scripture, on the basis of the more elaborate suggestion-blocks 
used by Seashore, in the form of a special law.* 

Results. — (1) Dependence on age. Sample results for nor- 
mal children are those of Gilbert (Table 121) : it will be seen 
from them that the illusion is well developed at the age of 0 
years, increases gradually till 9 years, and thence declines 
slowly with age.® Dresslar (C), however, whose method was 
undoubtedly less satisfactory, judged the effect of age to be 
indifferent for 7 years and above. Philippe aiiO Clavi^re, who 
tested children from 3 years up, declare that the illusion de- 
creases progressively below the age of 7, that it is obtained by 

TABLE 121 

Force of Suggestion (Oilbert) 


AGE 

6 

7 

8 

9 

10 



.3 1 

14 

15 

16 I 

NB 

45 

50 

46 

47 

49 

43 

54 

1 

j45 

47 

49 

47 i 

NG 

47 

45 

46 

47 

42 

48 

;49 

58 

53 

51 

39 1 

V 

42.0 

45.0 

47.5 

50.0 

43.5 

40.0 

! 40.5 

' 38.0 

34.5 

35.0 

34.5 

P.— 

36 

|37 

27 j 

36 ; 

,23 i 

!22 

! 15 

1 8 1 

1 7 

12 i 

0 

MV 

17.0 

15.5 

13.5 

10.5 

!12.5 

! 11.5 

; 9.0 

; S.0 

1 9.5 

10.5 

10.0 j 



43.5 

43.5 

45.0 

50.0 

' 40.0 

^ 38.5 

38.0 

37.0 

31.0 

I 33.0 

32.0 : 

“ 1 

42.0 

i 43.5 

1 

49,5 

49.5 

i 1 

44.0 

: 40.0 

: 41.0 

1 

,38.0 

3:3.5 

1 

3S.0 

1 

L!i 


JSB nuiubtT of boys 
NG = number of girls 

F — force of suggestion, In grams, for both sexes (median values) 
p — per cent, of cases in which F exceeded 05 g., the limit used 
MV = statistical iiioan variation 

FB ~ force of suggestion, in grams for boys (rc.eilian values) 

ITG ■-= iorce of suggestion, in grams, for girls (median values) 


*For the data from which this law is derived, see Scripture (19, p. 27Gf), 
also Seashore (15, pp. 3-lt). For a striking demonstration of the force 
of the illusion, reference may be made to Wolfe's statements that “about 
one woman in 7 finds 1 g. of lead eniial In weight to tlO g. of inflated paper 
bag,” and not “one woman in 7 will fiud a gram of inflated paper bag lialf 
as heavy as a gram of lead” (21, p. 4G0). 

•Gilbert’s explanation is given in the following terms : “At G he has not 
yet learned to compare. As be learns gradually to judge a thing from 
more aspreta than <>ue, or in other words, learns to interpret one sense by 
another, the force of suggestion given by the eye to the muscle iu( reases 
until at 9 he has come to the age of exj>ericnce enough to see that things 
are not always what they seem. Consequently at this age he begins to 
correct misleading influences bearing upon him.” 
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only a third of the children 3 to 6 years old, that it would per- 
haps disappear entirely if the test could be carried below the 
age of 3. They also found that the illusion is sometimes re- 
versed in children of these ages. 

(2) Dependehcc on menial age {defective children). In 1900 
Demoor and Daniel (4) used the size-weight illusion, together 
wdth other tests, in an examination of 380 ^abnormaP' children, 
(> to 15 years of age, in the city of Brussels. Ten of these chil- 
dren, all of them ranked as idiots or ^simple-minded/ either 
failed to get the normal illusion or had the illusion reversed. 
Three years later Clapardde (3) obtained similar results with 
18 mentally defective children at Geneva, and proposed that 
‘Demoor’s sign’ (failure to get the normal illusion) should be 
I’egarded as indicative of a diagnosis of medical (mental) re- 
tardation. In 1913 Doll (5) reported upon the examination at 
the Vineland Training School of 345 feeble-minded, of chrono- 
logical ages 5 to GO, and mental ages 1 to 12 years. The results 
(Table 122 and Fig. 75) show that ability to perform the test at 
all (with or without getting the illusion) indicates a mental 
age of 4 years or over, while getting the normal illusion indi- 
cates a mental age of 7 years or over, since 84 per cent, succeed 
at 7 years and 100 per cent, at 8 years and above. 

TABLE 122 

lieactions of Fcehle-Mhided Children to the Sizc-Wci(jht Illusion {Doll) 


MENTAL AGE 

NUMBER 

TESTED 

COMPLETE 

FAILURE 

NO ILLUSION 

ILLUSION 




% 

[ 

j 

% 


% 

1 

35 

34 

97.1 

1 1 

2.9 

0 

0.0 

2 

37 

28 

75.7 

3 

8.1 

. 4 

10.8 

3 

38 1 

17 

44.8 

8 

21.6 

12 

31.6 

4 

32 

5 

15 .G 

14 

43.7 

13 

40.7 

5 

35 

5 

14.3 

9 

25.7 

21 

60.0 

6 

36 

2 

5.6 

12 

33.3 

22 

61.2 

7 

45 

3 

6.7 

4 

8.9 1 

38 

84.4 

8 

41 

0 

0 

0 

0 

41 

100.0 

9 

25 

0 

0 

0 

0 

25 

100.0 

10 

12 

0 

0 

0 

0 

12 

100.0 

11 

4 

0 

0 

0 

0 

4 

100.0 

12 ... 

5 

0 

0 

0 

0 

5 

100.0 

Total... 




51 


m 
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Per'ceotooe 



[:\) Dcpcndvnce on sac. Tlie relalioii of sex lo siij>gestion by 
ifee size-weighl illusion lias been differently slated by different 
investigators. Dresslar, for example, eoneludes that boys are 
more suggestible than girls. Wolfe, on the eontrary, states that 
'‘men are less prone than women to illusions of weight,” and 
that, in eomjiaring wooden Avith lead Aveighls, ‘‘the Avomen 
overestimate the lead nearly tAvice as mueh as the men.” Gil- 
bert and Seashore find females more suggestible than males, 
in nothing like the degree stated by Wolfe. Thus, inspeie 
tion of his table shoAvs that, according to Gilbert's method, 
after the age of 0, girls are, on the average, more influenced by 
the illusion than are boys. Seashore ( 16 ) tested 17 AA^omen and 
28 men with tAvo test-weights quite different in size, and found, 
similarly, that on the a\erage the Avomen showed the stronger 
illusion. 
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(4) The relation of intelligence to suggestibility among nor- 
mal children has not been treated as carefully as the problem 
warrants. Gilbert made no correlations with intelligence. 
Dresslar concluded tliat bright children exhibit a stronger illu- 
sion, but Seashore (13) .contends that Dresslar^s method (ar- 
rangement in serial order) did not atford a real measure of the 
strength of the illusion. 

(5) Practise^ even if regular and persistent, does not dispel 
the illusion. It may, on the contrary, increase in amount 
(Ilollingworth). If >8 be told the nature of the illusion, it still 
persists, though its intensity is thereby somewhat reduced 
(^^eashore). 

(61 If the metlu)d of }>rocedure be nuMlified, the strength of 
the illusion will ]>e altered. 

Tlio more hnportnat of tlio relations thus reveahMl are the following:" 

(o) “'ri)(‘ illusion of wt'iglit UepemPuit on size Is greatest when size 

esfiinati'd niainly hy niusclo-sonse, and the weiglits hav(‘ nid i>re\ioiis]y 
h(‘en seen.” I’onrvhe says it is then tliree thm?s as strong. 

(h) “The illusivm is more thietiirding and on liie wJiole not qiiito so 
strong wlien size is estimated by the area of pressure in the flat palm, in- 
eluding a nuanory of the third dimension.” 

(e) “In these variations, the illusion is weakest when size is estimated 
hy direct sight.” 

(d) “\Adien size is estimated by the eonil>ined effect of all the spatial 
senses, tlie illusion fs weaker tlian .when depending on muscle-sense or 
toiK'h, and stronger than when dependent on siglit alone.” 

(c) Udio illusion is weaker when the blocks are viewed in indirect 
vision, and still weaker when judged by visual memory. 

(f) A knowledge, or sup})osed knowledge, of tlio material of which 
weights are made may affect the estimate of their weight. 

{(j) The illusion does not necessarily vary directly with the volume of 
the comiiarod weights, hut depends in part upon the manner in which the 
ditYeronee in volume is brought about. 

(7^> The illusion obtains among the blind, where it follows the same 
gonera.1 law as for the seeing, though it is not so strong, either for lifted 
or merely ‘touchecT weight.^, as for the seeing under the same conditions 
(Rice). 

Notes. — The outcome of any test of weight-comparison is 
somewhat affected by the tendency felt by all >Sf's, though dif- 
fering in degree between different individuals and in the same 
individual at different times, to overestimate the second of two 
lifted weights. 


'See, especially. Seashore (15). 
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If blocks of different material, e, g., cork and lead, or wood 
and iron, be constructed in such a manner as to have the same 
dimensions and the same Aveight, the knowledge of the artnal 
differences in the weight of the two materials produces an illu- 
sion similar to the size-weight illusion. Seashore (16) tested 
school children with this maierial-iceight illusion, and found 
that the overestimation of the metal blocks amounted to from 
7 to 11 grams (or from 13 to 20 per cent, of their actual weight, 
55 g.). For this illusion, it is of interest to note, there was 
found virtually no variation with age, sex,* or intellectual 
ability. 
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TEST 41 

Suggestion by progressive weights. — This lost Jik(‘ (hiU which 
follows it, is one of several devised hy Binet for the purpose of 
securing a quantitative measure of the degree of suggest il)ility 
of children or adults when the suggestion is hlepersonalized,' 
in the sense that it is derived by 8 himself from (he objective 
conditions of the experiment, rather than from the attitude, 
tone, instructions, or personality of E. The principle embodied 
in this test is, in other words, the arousal, by auto-suggestion, 
of a ^hlirective idca,^’ or the rapid development of an attitude 
of expectation. Suggestibility is measured, at least a])proxi- 
mately, by the ease with which this suggestion, or habit, of 
judgment, is aroused and by the persistence that it displays 
under conditions which tend gradually to counteract it. 

Materials. — A set of 15 weights, of identical size and aj)- 
pearanee, numbered eonspieiioiisly from 1 to 15. The first four 
weigh 20, 40, (jO, and 80 grams, respectively; the remaining 11 
weigh 100 grams each. Table of such a height that >S' can stand 
in front of it and lift the weights leadily. A thick gray or 
black cloth. 

Preliminaries. — Spread the cloth over the table. Phue the 
15 weights in a line as numbered, with the lightest on the I(*ft and 
the 11 heaviest on the fight, and with about 2 cm. between each 
weight. No. 1 is then at the left, No. 15 at the right of the row. 

Method. — Give 8^ the following instructions: ^^Hevc is a 
series of weights, 15 of them. I want you to lift them, one after 
the other, like this. [Illustrate hy taking a weight between 
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thumb and finger and lifting some 10 cm. from the table.] As 
you lift each weight, I want you to tell me whether it is heavier, 
lighter, or the same as the one just before it. All you have to 
say is either ‘heavier/ or ^lighter/ or ^the same.’ Kemember 
you ai-e to compare each weight with the one you lifted just be- 
lore. For instance, when you lift the 8th, you are to say 
whether it is heavier, lighter, or the same as the 7th. Here is 
the first weight, number one, at the left end of the row.” 

Watch to see that he follows these instructions, ]>articu- 
larly that he lifts the weights successively, without relifting 
earlier ones. Ke(*ord his judgments verbatim; be (areful, also, 
to note any seiondary evidences that might throw light on his 
judgments, e. //., attitudes or expressions of hesitancy, assiir- 
auce, surprise, embarrassment, cautiousness, etc. 

Variations oe Metiiod. — (1) In the second method followed 
by Binet, SI is instructed to lift, in each trial, the jmeceding 
weight as well as the one that is being judged, e. //., he lifts the 
8th, then the 7th, then the 8th again: next the Dth, then the 
8th, then the 9th again, etc. The lifting is all done, as before, 
with the- one hand. 

(2) In the third method followed by Binet, S is asked to esti 
mate the first weight lifted. He usually gives too small an 
estimate. He is then told that its weight is 20 gi*ams (about 
0.7 ounce). The series is now compared, using either of the 
methods of lifting above described, according to preference,^ 
but ^ is required to estimate or guess the heaviness of each 
weight, basing his judgment, of course, merely on the knowledge 
that the first w^eight is 20 gi‘ams. 

Treatment of Data, — From the tabulated results, E may 
easily determine in how many cases the objective progression 
of the first 5 weights was correctly noted. For a measure of 
suggestibility, E must take the number of times dieavier’ is 
judged in the last 10 judgments (when ^same’ is the correct 
judgment). This measure is admittedly somewhat crude, but 


Ut woiild, obviously, ho better to proscribe either the one or the other 
method for all The first method has the merit of taking less time, 
and it is the method that is for the most part naturally adopted by 
> ouuger iS’s. 
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it affords a fairlj^ reliable index for determining the relative 
order of rank of a group of ^S’s. Thus, an >Sf that judges dieavier' 
10 times is unquestionably more suggestible than one who an- 
swers dieavier’ but 5 times, thougli not necessarily twice as 
suggestible. 

If all three methods are employed, E may determine >S’s sug- 
gestibility by adding the number of false dieavier" judgments 
in all three tests. In the third method, the quantitative esti- 
mate given by /Sf for the 15th weight (or the maximal estimate 
for weights 6 to 15) might be taken, in com})arison with his 
estimate of the 5th weight, as an index of suggest ibilily, but 
this method is not regarded by Binet as so reliable as the one 
already described. 

Results. — (1) The general outcome of the test as conducted 
by the first, or standard, method is indicated in Ta])le 123, which 
embodies the results obtained by Binet u])on 24 elementary- 
school children, aged 8-10 years. 

(2) It is evident that, in children of this age (8-10), not all 
judge correctly the actual objective in(*rease in the first five 
ivcifjhts. Rince the differences are supraliminal, the exceptions 


TABLE 123 

The rrogressive-Weif/ht St(ggcstio)i, 2/f Cases (Binet) 


NO. OF WEIGHT 


2 3 4 


II 12 13 


Actual weight 

Times estimated + 

Times estimated - 

Times estimated = 


I I I I I 

20,40 60 80,100;100 100:100 100100 100 100 lOOlOO 100 


2419 

0 , 1 

0 4 


19. 23, 13; 181 181 18 12 


10, 19; 171 15i 12 

2! 2! 3^ 3j 5 

3; 4! Gi 7 


must be ascribed to faulty attention, though, ])ossibly, the fact 
that the weights are of equal size may have clouded the direct 
perception of weight by lifting. 

(3) In general, the suggestion is still working, though less 
powerfully, at the 15th trial: in other words, it has persisted, 
for most through the successive lifting of 10 equal weights. 

(4) There is a marked drop in the judgment dieavier^ at the 
6th iveight, i, c., at the first Trick’ weight — a drop which is, 



TEST 41 : PROGRESSIVE, WEIGHTS 


[601] 235 


obviously, due to a ^disappointed suggestion,’ analogous to that 
which conditions the size-weight illusion of the preceding test. 
In the present instance, /Sf is, in most cases at least, prepared io 
find the 6th weight heavier than the 5th: he puls forth more 
etfort; the weight rises with unexpected ease, and is, therefore, 
often judged lighter.’ If, however, S is more inlluenced by his 
expectation of ‘heavier’ than by the unexpected lightness of the 
weight, he still judges ‘heavier,’ or he may, from the conflict 
of these two tendencies, judge ^equal.’ 

(5) Practise has very little effect upon the suggestibility of 
;S^’s : at least Binet found that, when 12 older children (16 years) 
repeated the test by the first method five times in imniediale 
succession, there was no alteration in the average number of 
times that suggestion apj)eared (the average number of sug- 
gestions in the five trials was 5.1, 4.9, 5.4, 5.0 and 5.5, lespecl- 
ively). 

(6) Billet’s tentative experiments indicated that a(fc appar- 
ently has less effect upon suggestion by progressive weights lhaii 
upon suggestion by progressive lines (see the following test). 
In trials by the first method, 12 children aged 16 years re- 
sponded, on the average, with 5.1 suggestions, whereas 24 chil- 
dren aged 8-10 years, responded, on the average, with 6.75 sug- 
gestions. The later experiments conducted under Binet ’s direc- 
tion by Giroud show a distinct lessening of suggestibilily after 
9 years when only those 8^’s are considered who made no errors 
in the first four judgments (objective increase of weight), as is 
indicated in the last column of Table 124. 


TABLE 124 

AveraffGs for Progressive-Weight Suggestion hg Age {Giroud) 


AGE 

HEAVIER 

JUDGMENTS 

CONSECUTIVE 

HEAVIER 

JUDGMENTS 

1 

EQUAL 

JUDGMENTS 

! 

HEAVIER- JUDGMENTS OF S’S MAKING 
NO ERROR WITH OBJECTIVE 

INCREASES 

7 

6.5 

5.5 

2.3 

8.4 

8 

i 6.6 

5.3 

1.6 

7.0 

9 

5.2 

2.4 

2.0 

8.0 

10 

1 7.0 

4.8 

1.2 

4.5 

12 

5.0 

3.6 

5.0 

5.0 
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(7) According to Binet, comparison of the results of this test 
with oilier tests of suggestihUxty, especially the line-test, indi- 
cates a fair degree of correlation, so that, while the sense-de- 
partment under examination may in part determine the extent 
of suggestion, very suggestible >S'’s may be expected to prove 
noticeably suggestible in all tests. On the other hand, tests 
undertaken in the Educational Laboratory at Cornell Univer- 
sity" do not conlirm BineUs statement, and lead one to believe 
that 8cott’s conclusions (Test 44) are correct, when he asserts 
that there is no such thing as general suggestibility. 

(S) Pro(ediire by ihe secoiid method (compulsory lifting of 
the antecedent weight) makes the real ]>rogression (Ist five 
weights) more uniformly evident, but redines the illusory 
progression. 

(b) Procedure by the ihird method, (estimates of each weight) 
jiroduees less suggestion than the first, but more than the sec- 
ond method. Inspection of the estimated weights (giains) 
show (a) that /S^'s have a decided i)referenee for the use of num- 
bers terminating in 0 or 5, (h) that no one of the 24 iS^’s over- 
estimated the oth weight (100 g.), but chat they commonly 
greatly underestimated it (30 to 50 g.), and (c) that those 
that showed the greater number of suggestions also gave, on 
the average, the largest quantitative estimations for the illusory 
increments. The correlation of suggestibility under these two 
methods of treatment (first and third) was found by Okabe and 
Whipple to be 0.53. 

REFERENCES 

(1) A. Rinot, Tax snf:;^cstil)nito. Paris, 1000. Ch. iv. (pp. 101-208). 

(2) A. (liroiid, T.a ibilitC cliez tics enfanfs U’CcoIo do sept Jl 

douzeans. 18: 1012,302-388. 

TEST 42 

Suggestion by progressive lines.— The purpose and general 
plan of this test are the same as in the preceding test of sugges- 

^hese tests, whioli were conducted by T. Okabe, under the author’s 
directions, included all tbe suggestibility tests of Binet, together with the 
warmth tests (No. 44). The results of their application to. 29 8’s indicate 
almost total lack of correlation of suggestibility In tbe several testa. 
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tion by progressive weights, and the details are again derived 
from the work of Binet. 

Apparatus. — A sheet of cross-section paper, ruled in inilli* 
meter squares. Kymograph drum, with kymograph or some 
form of supporting stand. Cardboard. Strij) of white paper, 
15Xli5 cm. Drawing materials. 

Preliminaries. — Arrange the kymograj)]! drum so that it 
may lie horizontally and be revolved freely by hand. It may 
conveniently be left in the kymogra])h with the driving ^slep’ 
loosened, or be placed in the smoking stand. Aefoss the strip of 
white pa])er, draw with a ruling jieii 20 parallel, straight, black 
lines, 2 cm. apart and each 1 mm. wide. The lines must begin 
at varying distances from tho left hand margin : the first four 
are to be 12, 24, 30, and 4S mm. long, respectively; the remain- 
ing 10 are to be each GO mm. long. Siipjmrt the sheet of card- 
board vertically in front of and close to the kymogra[>h drum, 
and cut a horizontal slit 1X1- cm. through the cardboard in 
such a position as to expose the ruled lines, one by one, as they 
are turned past the slit.^ 

Method. — Seat /S^ 50 cm. from the screen* and provide him 
with a sheet of cross-section j^aper. The instructions should 
take the following form : want to try a test to see how good 

your ^eye’ is. I’ll show yqii a line, say an inch or two long, and 
I want you to reproduce it right afterwards from memory. 
Some persons make bad mistakes; they make a line 2 inches 
long when I show them one 3 inches long; others make one 4 
or 5 inches loAg. Let’s see how well you can do. I shall show 
the line to you through this slit. Take just one look at it, then 
make a mark on this pajier [cross-section paper] just the dis- 
tance from this edge [left-hand margin] that the line is long. 
When that is done, I shall show you the second line, then the 

Tn default of the kyinograpli, the strip of ruled lines may be laid flat 
upon the table and exposed through a 1 X 12 cm. slit cut in the center of 
a sheet of cardboard 55 cm. square. 

Or, the test-lines may be drawn as sections of radii upon a cardboard 
disc which is supported vertically just behind the screen and rotated to 
bring them Into view suc cessively. 
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third, and so on. Make the marks for the second on the line 
below the first, the third on the next line, and so on.’’" 

E then turns the drum to bring the first, or shortest, line into 
view. As soon as S turns hi>s attention to the recording of his 
estimate on the jjaper, the drum is moved forward slightly to 
conceal the line, so that further comparison is impossible. As 
soon as /Sf has placed his mark, then, and not before, the next 
line is exjjosed. This precaution serves to maintain the im- 
pression that a new, and hence probably a longer line is ex- 
posed. Slow may need to be hurried; too quick ones may 
need to be checked, so that the interval between successive ex- 
posures shall be approximately 7 sec. To keep /8’s attention 
alive, E may accompany the exposures with non-suggestive re- 
marks, c. ^^Here is the second line.” ^^Here is the third,” etc. 

If *8 has ceased to respond to the suggestion of progressive 
augmenlation at the 20th exposure, the test ends at that point: 
if not, E should, without /^'s knowledge, bring the drum back 
to the 5th line, and continue the exposures of the series of 60 
mm. lines as before, until S does cease to respond to the sugges- 
tion. 

E should note .aud record any significant features in 
manner, c. //., signs of embarrassment, hesitancy, automatic 
response, etc. 

AATien the test is completed, and provided no further tests of 
suggestibility are to be undertaken at the time, E will find it 
advantageous to quiz S with regard to his attitude toward the 
test. This interrogation must be very tactfully conducted. E 
may, for example, begin by saying; “Are you entirely satisfied 
with what you have done”? If ^ answers in the affirmative, 
let E continue with such inquiries as: “Do you think you have 
made any mistakes”? “Did you make any lines too short or 
too long”? “xVt what moment did you notice that your lines 
were too long”? “AVhy didn’t you make them shorter”? etc. 

•Tneso diioi tioiis slioiild be followed with some care. In tbsts of sug- 
gestion, the shkdile.st (hange in the setting of the test, or in the manner or 
content of thr^ insirnciions, may materially affect S's attitude toward the 
ex|H‘rinient. 1’lie ol>j(H t is to convey the idea of a straightforward test of 
accuracy of line-reproduction, and to avoid arousing any suspicion of 
snares or tricks. 
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If confesses that he made some mistakes, let him take his rec- 
ord-sheet and make the changes that he thinks ought to be made 
to produce a correct record, using small circles for his correc- 
tions to avoid confusion with his first estimates. 

Variations of Method. — E may, if desired, adopt the ar- 
rangement first used by Binet, according to which there are 12 
successive sliniulus-lines, all of which begin at the same dis- 
tance from the left-hand margin, and which have the following 
lengths : 12, 24, 3G, 48, GO, GO, 72, 12, 84, 8^, 9G, 96 mm. It is 
evident that numbers 6, 8, 10, and 12 constitute four ^trap-lines, ^ 
since the arrangement suggests progressive ' augmentation, 
whereas each of these four lines is equal to that which imme- 
diately precedes it. 

Treatment of Data. — (1) For a measure of suggestibility, E 
may take the number of lines out of the last 15 lines that are 
drawn longer than the 5th line was drawn. 

(2) A coefficient of suggestibility may also be calculated, 
following Binet^s method, by the formula 

a? : 100 = max. L : 5t1i L, 

in which 

X ~ the required coefficient, 

max. L “ the length of the maximal line recorded by S, 
oth L 1 =: the length of the 5th line as recorded by a 8. 
Absence of suggestibility is, then, indicated by a coefficient of 
100 : presence of suggestibility by a coefficient of over 100. 

(3) When the variant method is used, the degree of suggesti- 
bility may be determined roughly in terms of the number of 
^traps’ in which S is ‘caught,’ or more exactly, by the formula 

X : 100 = c\r, 

in which 

X = the required coefficient, 

c 1 = the average recorded increment of the four trap lines, 
r ~ the average recorded increment of the four lines im- 
mediately preceding ihe four trap-lines. 

Results. — (1) In his examination of pupils in the elementary 
schools, aged 8-10 years, Binet found that the coefficient of sug- 
geatibility ranged from 109 to 625. In 16 of 42 pupils, the coeffi- 
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cient was 200 or over, i. e., tlie maximal line was double or more 
tban double the 5th line.* 

Witli tlie variant form of test, Blnot foiiud the coofiiolent lying between 
7.0 and 120. No one of 45 children avoided all four ‘traps,’ and 50 chil- 
dren avoided none of theiii. Occasionally, the traji-Iiiio, presumably on 
account of the contrast between the sliinuliis and the child’s expectation, 
was actually recorded as shorter than the preceding line. K’s whose co- 
ellicient ia this fnriii of test is 100, /. c., whose average increment for the 
tra))dines is the same as for tla^ ohjiH-tively progressive lines, are termed 
‘automalic.* 

(2) The point at wln'ch ma.rimal is registeml 

1*8 ('Oininonly between tlie IDIli and the 2511] line, but may lie 
anywhere between the 7th and the oldli (this bein<*‘ the limit 
tested by liinet). 

{f^) Inspection of the records of individual ]di]>ils shows 
that in some cases the force of suggest ion was steady and i>er- 
sislent, while in others it reached a maximum, and then do-. 
cliiKKl. 

(4) Exironclij su<j[/cstiblc S'h may make iluar ‘estimate^ of 
the line without even looking at it when exposed; their minds 
are so comiiletely dominated by the suggestion of uniform 
angineiitation that they do not trouble to observe the stiinnlus. 

(5) The degree of suggestion induced by this test declines 
markedly with age: Binet found, for instance, that the coefti- 
cients of suggestibility, in the case of 12 pujiils whose age aver- 
aged Id years, ranged only from 103 to 140. Binet's work was 
continued by Giroiid, who tested 38 childit^ii and obtained for 
averages, on the basis of a possible score of 15, the following 
averages for the number of times any line beyond the 5th ex- 
ceeded the length assigned to the line just before it: 


YEARS 

7 

8 

9 

10 

12. 

Oases tested 

10 

10 

5 

5 


Score 

10.7 

8.2 

4.2 

4.8 

1.0 


That it is difficult to induce the suggestion with adults w^as 
showm in scattered tests made by the author upon college stu- 
dents. On the other hand, Ohojecki, who tested 30 men and 30 

*For detailed records of number of individual cases, consult Binet, 124ff. 
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women students of the University of Geneva, had better suc- 
cess, and found, indeed, 3G persons (22 men and 14 women) 
susceptible of suggestion by this method. 

(6) In either form of test, the 1st line is apt to be over-esti- 
mated. The 5th line is almost invariably underestimated. Gen- 
erally speaking, this underestimation is less pronounced in 
those that prove least suggestible. 

(7) In many instances, the records bear witness to a struggle 
between the directive idea of progressive increments and the 
impressions which are aclualiy received from the lines a^ they 
are exposed. Especially characteristic is the ai»pearance of a 
number of estimates in which the directive idea is effective, 
followed by a sudden reduction in estimation, which is again 
followed by another series of progressive increments. In other 
words, the idea of progression is o})erative until a point is 
reached when the recorded length is manifestly too long. S 
makes, then, a more or less marked correction, but does not, 
curiously, relinquish the ifbtion of i)rogression, and this again 
becomes manifest. 

(8) The corrections made by young S’s during the inquiry 
that follows the test cannot, of course, be-taken as exact indi- 
cations of the extent of the suggestion or of their consciousness 
of error. It will be found that many are conscious that they 
have made the lines loo long; some can also explain why they 
made them too long; but it is rare that any one gives a satisfac- 
tory explanation of why he continued to make them too long, 
after he realized that he had been overestimating. 

(9) Correlations, Tests of school children and of adults by 
Okabe and Whipple afforded the following correlations (foot- 
rule method) : Suggestibility for progressive lines (number of 
^yields’) and suggestibility for progressive lines (maximal di- 
vided by the 5th line) 0.38; correlation, by either tmatmeut, 
with contradictory suggestion, (Test 43) about 0.25, with 
directive suggestion (Test 43) about 0.20, with suggestion for 
warmth 0.17, with the size-w^eight illusion (Test 40) 0.10 by the 
first, and — 0.14 by the second method of computing suggestion 
for progressive lines. 
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TEST 43 

Suggestion of line-lengths by personal influence. — In the three 
preceding tests suggestion is produced by the objective condi 
tious of the test : in everyday life, however, suggestion is often 
produced by personal influence, by authoritative statement or 
command, or merely by what Binet terms ^inoral influence.’ 
Two forms of line-test have been utilized by Binet to study 
this variety of personal suggestion : the first he terms Contra- 
dictory suggestion,’ the second ‘directive suggestion’ [suggen- 
lion dirccirive) : in tlie former E makes certain statements that 
are intended to interrupt or modify a judgment that S lias just 
made; in the latter, statements that are intended to control or 
influence a judgment that /S is just aibout to make. 

A. CONTRADICTORY SUGGESTION 

Materials, — Drawing materials. A sheet of cardboard upon 
which are drawn in ink 24 parallel, straight, black lines, rang 
ing in length from 12 to 104 mm., by increments of 4 mm. The 
lines all begin at the same distance from the left-hand margin, 
are 7 mm. apart, and are numbered in order of their length, 
from 1 to 24. Three rectangular jiieces of cardboard, about 
12x20 cm., on each of which is drawn a single straight line. 
These three stimulus-lines correspond to numbers G, 12, and 18 
of the 24 comi>arison-lines, and are, accordingly, 32, 56, and 80 
mm. long, respectively. 

Method. — Show 8 the card of^comparison-lines, and explain 
their numbering. Replace this by the first stimulus-line (32 
mm.), saying: “Look carefully at this line.” After 4 sec., re- 
move the stimulus-card, present the comparisoh-card, and say : 
“Tell me the number of the line that is just the length of the 
one I showed you.” At the moment that 8 gives his judgment, 
jE? says : “Are you sure? Isn’t is the — th” ? — indicating always 
the next longer line. If 8 answers “No,” E repeats the question 
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in exactly the same form. If S still answers “No/' the attempt 
to produce suggCvStion is suspended, and the case is recorded as 
one ^resistance.’ The second and the third stimulus-lines are 
presented and the same procedure is followed in each case. 
If, in any of the trials 8 answers “Yes,’’ IJ then inquires: 
“Isn’t it this one”? — iudicatingJhe next longer line, and this 
inquiry is carried on from line to line until S has twice resisted 
the suggestion, i. e., has twice answered “No” to the same ques 
tion.^ 

Variations of Method. — For many >S”s, phrticularly for 
adults, more success will attend the use of a second method 
tried by I>inet in preliminary tests', viz.: the introduction of an 
intei'val of 12 sec. between removal of the si imiilns line and 
{tresentation of the comparison-card. 

Treatment of Data. --Following Binet, /S’s suggestibility 
may be rated in terms of the total number of ‘advances’ in lines 
that he makes, under inquiry, in all three trials. Thus, if he 
‘yields’ two lines the first time, three the second, and none the 
third, his suggestibility is rated as 5. 

Results. — (1) Children tend to select for their first line one 
that is shorter than the stimulus-line." 

(2) Of 25 children, aged 8-10 years, Binet found G who re- 
sisted suggestion completely, G who ‘yielded’ once, 5 twice, 2 
three times, 2 four times, and one each six, seven, and more 
than seven times. 

(3) Preliminary experiments conducted by Binet and Henri 
upon 240 pupils, with some slight changes in method (particu- 
larly, giving an opportunity both for direct comparison and for 
selection by memory after a 12 sec. interval), yielded the re- 
sults (2 : p. 343) indicated in Table 125. 

Here it is evident that iiJ’s suggestion is less effective when 8? 
can inake direct comparison of the lines, and that suggestibility, 


*Once more it should be said that it is highly important to follow the 
same loiun of inquiry, to use the same tone, the same attitude, in every 
question for eveiw since the suggestion which we seek to measure is 
conditioned by the character of the inquiries. 

is almost always, therefore, in a i)osition to demonstrate to iS', if 
need be, after the test, that his suggestion would have been a sound one 
to follow. 
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TABLE 125 

Percentage of *yicl<Js' to Contradictory Suggestion (Binct and Henri) 


AVERAGE AGE 

MEMORY TEST 

COMPARISON TEST j 

MEAN 

7-9 

89 

74 

81.5 

9-11 

80 

73 

76.5 

11-13 

64 

48 

51.0 


under either direct comparison or comparison from memory, 
declines with age, 

(4) >8'’s who have selected the correct line are less apt to 
change their designation under suggestion than are >S’s who; 
have selected the wuong line: thus Binet and Henri found that 
5G per cent, changed j:heir selection when it was actually right, 
but 88 per cent, when it was wu*ong. Moreover, of the latter, 
81 per cent, made the change in the proper direction. 

'' n. DIRECTIVE SUGGESTION 

Apparatus. — As in Test 42, save that only the 00 mm. lines 
are used. 

Method. — Seat S 50 cm. from the cardboard screen and j)ro 
vide him with a sheet of cross-section paper. Instruct him as 
follows: ‘Hhn going to show you a number of lines. You will 
see them appear through this slit, one at a time. When I show 
you a line, take a good look at it; then make a mark on this 
paper at just the distance from this edge [left-hand] that the 
line is long. When that is done, I shall show you the second, 
then the third, and so on. You will make the mark for the 
length of the second line on the second line of your pa]>er, for 
the third on the next line, and so on.^^ 

E now displays the 5th, L e., the first GO mm. line of the series, 
with the remark: ‘^Here is the first one.^’ When S is ready for 
the second line, i. c., 7-10 sec. later, E remarks, as he exposes it : 
‘‘Here is a longer one.” When the third is exposed, he l emaiks 
‘‘Here is a shorter one;” and he continues to use these remarks, 
alternately, at the moment of exposure of each line, until 15 
lines have been exposed, the first without suggestion, the re- 
mainder coupled with 14 suggestions — 7 of shorter, 7 of longer. 
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These suggestions must be given just before the line is ex- 
posed, in a quiet tone, without looking at aS. S should see the 
disc turn and the new line appear at the moment that he re- 
ceives the suggestion. 

If desired, S may be questioned afterward, as indicated in 
Test 42, with regard to his attitude toward the suggestions. 

Tueatment op Data. — When S accepts the suggestion, record 
a Spins’ case; when he resists the suggestion, either by making 
the length equal to that of the preceding line, or by altering the 
length in a direction contrary to the intent of, the suggestion, 
record a ‘niinus^ case. The number of the })lus cases may serve 
as an index of ^^s suggestibility. Record should also be kept of 
the extent of modification (in inm.) made by S in each trial. 

Results. — (1) The verbal directive suggestion used in this 
test is more potent, at least for children 8-10 years old, than the 
auto-suggestion induced in Test 42. Sixteen of 23 pupils tested 
by Rinet submitted completely to the suggestion,'^ and no one 
resisted every suggestion. 

(2) The suggestion is, in general, stronger at the outset than 
toward the end of the series, ns is indicated by the fact that the 
extent of modification of line-length decreases, and the number 
of complete resistances increases, as the series progresses. 

(3) Verbal suggestion is commonly more effective in pro- 
ducing augmentation than in producing reduction in line-length, 
in the proportion of about 5 to 4. 

(4) There are marked individual differences in the suggesti- 
bility of school children under the conditions of this test. Rinet 
found that ni 18 trials tlie number of resistances to suggestion 
ranged from 0 to 14. (See Rinet, 1, pp. 228-9, for a detailed 
table.) 

(5) The first line is practically invariably underestimated. 

(6) Tests upon 10 children, whose average aeje was 17 years, 
vshowed less suggestibility than in the case of younger children; 
still, 4 of the 17 accepted every suggestion, and 3 others re- 
sisted suggestion only once. The average extent of modification 
produced by suggestion is^ however, less than in the case of 

*This statement is made in the text, hut docs not appear to be borne out 
by Binet’s table (1, PP. 228-9). 
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younger S’s! Again, the extent of modification is practically 
constant throughout in the series with the older but large 
at first and then progressively less in the series with the 
younger 

Notes. — The experiments of Bell, Brand and Jones, in which 
the estimates or judgments of S})atial magnitudes or extents 
were subjected to verbal suggestions, such as ^‘make high,*’ 
‘^ake low,” ‘^you are now able,*’ “you are now unable,” etc., 
cannot be directly compared with the work of Binet, because in 
all of them the S’s w^ere well aware of the intentional and arti- 
ficial character of the suggestions and were instructed to avoid 
voluntary resistance to them. In general, the suggestions in 
these experiments had some effect upon the work of the /Sf’s, 
but not upon all of them, nor always in the direction in which 
they w^ere supposed to influence the outcome. 
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TEST 44 

Suggestion by illusion of warmth. — In measuring either dis- 
criminative or liminal Sensitivity, difficulty is not infrequently 
caused by the interference of auto-suggestion (see various tests 
of Chapter VI). In the immediately preceding tests (Nos. 40 
to 43), a process of discrimination (of weights and line-lengths) 
was, accordingly, made the basis for testing suggestibility. In 
the present test, a (supposed) measurement of liminal sensi- 
tivity is made the basis for testing suggestibility. The plan is 
to arrange experimental conditions in such a w ay as to suggest 
warmth, when no warmth is present. 

This idea seems to have originated in the Yale laboratory, 
w^hen Seashore (5), in 1895, worked out a proposal made twm 
years earlier by Scripture (4). i Small’s varied tests of sug- 
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gestibility (6), which appeared in the following year, embodied 
two very simple ‘heat’ tests. More recently, Guidi in 1908, 
Hcott in 1910, and Chojecki in 1911, have reported tests of sug- 
gestibility to warmth, the former with a simple ‘warmth box,’ 
the latter with apparatus somewhat similar to the original de- 
vice of i>easlK)re. Four methods are described herewith; the 
resistan(‘e-wire method of Seashore and Scott, the heated box 
jnethod of Guidi, and the two simple methods employed by 
Small. 


A. ILI<USORY WARMTH RESISTANCE- WIRE METHOD 

Appauatvs. — Stop-watch. Special warmth-tester. 

Tiie warmtli'tostcr ooiisistK of a wooden box, open nt the end facing: 
and iTovided, on the toj), with porcelain sockets for four electric lanii)S, 
wired in multiple, and with a snap switch by which the current (I0r)110 
volt, D. C. ) may be turned on or off. The wiring is purposely loft visible, 
and leads conspicuously from the lamps to a coil of No, 24 German-silver 
wire, 1 m. long, which is wound, without covering, about a flat piece of 
hard rubher. 2x10 (an. This resistance coil is fastened to the front of 
the box, in such a manner that it may be easily reached by without 
exjiosing his fingers to the warmth of the lamps on the lop of the box. A 
concealed ( ircnit leads to a noiseless switch, undciaieath the box. which 
can be oiieratc'd by E without >S’s knowledge. Hy means of this switch, E 
may shunt the current through tlie coll, or cut tlio coil out entirely, with- 
out affectiim’ the illumination of the lamps.^ 

Freliminakies. — Find an arrangement of lamps such that, 
when the ciurent passes Ihrough the coil, warmth becomes per- 
ce]>iible in S to 10 sec. Four 25-watt tungsten lamps generally 
prove satisfactory. If necessary, use one or more lOAvatt lamps. 

Method. — Give aV the following instructions: “I want to 
test your ability to perceive warmth. Hold this coil of wire 
gently between your thumb and two fingers, like this [illustrat- 
ing]. You will see that the coil is connected with these electric 
lamps, so that, when I light them, a current of electricity c«Tn 
flow through the coil and warm it — it is made of German-silver 
wire, and offers a slight resistance to the current. There is 
nothing at all to be afraid of. You can’t feel any shock from 

Hn defniilt of a 110- volt circuit, a resistance- wire apparatus may be 
contrived with a battery, after the plan described by Seashore, though 
the absence of the illuminated lamps alters the experimental conditions. 
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the current, nothing but a slight warmth. Watch carefully, 
and, the moment that you feel warmth, say ^now.^ 

Without attracting attention, close the secret coil-switch, 
so that no current passes through the coil. After a preliminary 
^ready,^ snap the lamp-switch rather ostentatiously; start the 
stop-watch at the same instant, and lean forward in an attitude 
of expectancy, keeping one hand on the lamp-switch, as if 
awaiting /S’s ‘now.’ Snap the lamps off as soon as the ‘now’ is^ 
spoken. Record the time. Feel of the coil, or solicitously blow 
upon it, as if to cool it. ‘ Repeat the test 5 times with each 
hand, alternately. 

If S, at any trial, fails to get the illusion of warmth within 
00 sec., open the coil switch (without /S’s knowledge), so that 
warmth is actually felt, but record the trial as one ‘resistance,’ 
or failure. 

Variations of Method. — Following the plan of Seashore and 
of Scott, tell 8 that 20 trials will be made. Give a preliminary 
series of 5 trials with each hand, with objective warmth from 
the start, in each trial. Without interruption, continue with 
an equal number of trials in which the coil is not warmed unless 
8 fails to report warmth within a period of some 10 sec. longer 
than the average time at which he had reported warmth in the 
first 10 trials. 

Treatment of Data. — In either method, suggestibility is 
measured by the absolute or relative number of trials (without 
objective warmth) in which -S reports wannth. 

S may also be rated in terms of the quickness (number of sec- 
onds) with which the illusion is reported. 

B. ILLUSORY WARMTH — GUIDl’s IMETHOD 

Apparatus. — Stop-watch. Matches. Alcohol lami>, fitted 
with hinged extinguishing cap. Cubical wooden box, with a 
chimney-like metal top, a circular hole in the front face, and a 
hinged door in the back face (Fig. 76). 

Method. — iSr’s instructions are analogous to those in the re- 
sistance-wire method. “I want to test your ability to perceive 
warmth. I want you to thrust your forefinger into this box 
through the hole in front. I shall put this lamp into the box. 
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It won^t burn jou at all. Just watch very carefully, and say 
hiow^ the moment that you notice any warmth in the box.” E 
then lights the alcohol lamp, o})ens the door of the box, sets in 
the Iami)S extinguishing the tlamc as he does so, starts the 
watch, closes the door, and expectantly awaits xSf's judgments.- 

Materials. — Alcohol lamp. A pin thrust through the rubber 
tip of a pencil, or through a small bit of so^^ wood. Toothpick, 
or other bit of wood with a blunt point. Matches. Piece of 
cardboard, about 15x15 cm. Blindfold. 

Method. — (1) Let ^ see the lighted lamp and the pin in its 
holder. Instruct him as follows: am going to warm this 

[)in in this Hame, then touch it to the back of your hand to see 
if you can notice the warmth it makes. Don’t be afraid of be- 
ing burned, as it will not be hot enough for that, and I shall try 
it on my own hand first. 8ay ^now’ when you feel its warmth.” 
Blindfold S carefully. Go through the operation of heating the 
inn; say h*eady,’ but do not touch ^’s hand at all. Tf S reports 
warmth, ask him to describe the feeling: if he does not report 
warmth, repeat the test, but touch him on the back of tlie hand 
with the pointed piece of wood, to see if the contact is reported 
as Varm’ or ‘hot.’ 

(2) Light a match and move it around about 1 cm. above the 
back of /S’s hand. Call his attention to the ‘waves of heat’ that 
he feels. Blindfold him carefully. Ask him to see if he can de- 
tect the heat waves every time. Strike a match, and move it 
about over his hand, but hold the cardboard between the match 
and the hand. Repeat several times with cither hand. Note 
the nundier of times the suggestion is ^accepted,’ and any indi- 
cations of the readiness or degree of suggestibility. 

Results for all Methods. — (1) In general, the results of 
the warmth-illusion test appear to be conditioned primarily by 
the success of the investigator in creating a proper atmos- 

®GuIdi’s method deviated somewhat from the above, In that *Sf wns in- 
stiTicted to push his finger slowly Into the box against a metal disc, and 
degree of suggestibility was measured by the extent to which tlie finger 
had been Inserted when warmth was reported. This procedure presents 
dlflflculty In governing the rate of movement, and has, so far as the au- 
thor’s experience goes, no advantage over the procedure that has been 
recommended. 



250 [ 616 ] 


SUGGESTIBILITY 


phere of suggestibility, rather than upon the particular appa- 
ratus employed. Thus, Seashore met with amazing success. 
Of his 8 college students, only 3 resisted at all, and these but 
once or twice each, so that, in 420 trials, there were only 5 
failures to perceive heat. Small tested boys and girls from the 
7th grade and the high school: in 21 trials, 5 reported heat,' 
with no contact at all, 10 reported heat from the wooden point, 
while in 19 trials with the ^‘heat-waves,” 17 proved suggestible. 



FIG. 76 . GUIDl’S APPARATUS FOR THE WARMTH ILLUSION. 

(Modified by AVbipple.) 

C. ILLUSORY WARMTH SMALl/s METHOD 

Of Scott’s 20 college students, 0 ^yielded’ 10 times (of a pos- 
sible 10) ; 5 yielded 9 times; 2 yielded 4 times, and 1 each 8, 7, 
5, and 3 times. No one of the 20 aS’s resisted in every trial. 
ChojeckI, who tested 30 men and 30 women students at the 
University of Geneva, got positive results from 10 (31.8 per 
cent.) with the use of Guidi’s method. Okabe, who worked with 
school children and adults in the Cornell laboratory under the 
author’s direction, obtained positive results in 70.7 per cent, of 
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the trials, and with 22 of 29 iSf’s (Table 126). The Italian 
children tested by Guidi were less suggestible (at least for his 
method), as Table 127 shows. 


TABLE 126 

i^nggcstiWity to Warmth. Resistance-Coil Method {Olcahc and Whigpic) 


GROUP 

NUMBER 

i 

TRIALS 

j YIELDS 

1 1 

PER- 

CENTAGE 

OF 

SUGGEST- 

IBILITY 

CASES 

WITH 

NO 

YIELDS 

Men 

12 

59 

i 

43 

73 

1 

Women 

7 

1 29 

20 

69 

2 

Bright boys 

5 

' 36 

27 

75 

1 

Dull boys 

5 

33 

21 

61 

1 

Totals— 

29 

1 

157 

111 

70.7 

5 


(2) The relation to sex and to age cannot be stated with as- 
surance. Guidi’s results indicate maximal suggestibility at the 
age of 9, but the Cornell tests, perhaps from being too few in num- 
ber, failed to show characteristic differences between grammar- 
school boys and adults. It is likewise unsafe to generalize from 
the indications there given of the greater suggestibility of men. 

(3) ‘The degree of suggcstiMlity, as indicated by the readiness 
with which warmth is felt, differs, as might be expected, in 
different aS^'s, i. c., even of those who invariably ))erceive warmth, 
some repoi't only ^'faint warmth,’’ others “sudden heat,” etc. 
Guidi classed his pupils into three groups, according as they 
took the suggestion- quickly (in 1 to 2 sec.), moderately (2 to 3 
sec.), or slowly (after 3 sec.), and found 33 per cent., 03.7 per 
cent., and 3.3 per cent, of his ^Sf’s in these three classes, re- 
spectively. 

(4) Scott found no correlation between suggestibility as 
measured by the warmth illusion and suggestibility as meas- 
ured by his flight-of-colors test, Chojecki no correlations be- 
tween the results of his three methods, viz.: Guidi’s ^stove,’ 
Ochorowicz’s ^hypnoscope’ and BineCs progressive lines. 
Okabe’s tests afforded the following low correlations with other 
forms of suggestibility tests: with progressive lines (Test 42) 
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0.17, with contradictory suggestion (Test 43) 0.21, with di- 
rective suggestion (Test 43) 0.29, with the weight illusions 
(Tests 40 and 41) none. 

TABLE 127 


Suggestibility to Warmth, as Related to Age. 1S7 Cases (Ouldi) 


Age 

1 

..J G 

' 1 

1 1 

8 ' 

9 

10 

11 

12 

13 

14 

15 

Per cent, suggestible — 

■i“ 

40.9 

1 i 

51.8 

62.5 

50 

40 

33.3 

21.4 

27.3 1 

33.3 
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Tests op Imagination and Invention 

IniaginatioD, like most of the stock psychological terms, has 
the misfortune to be used in several different ways. In popu- 
lar usage, imagination commonly iinplii something fanciful 
and unreal; we condemn a rumor, for example, by dubbing it 
“‘a mere figment of the imagination/^ In psychology, imagina- 
tion has both a general and a specific meaning. Broadly s^ieak- 
ing, imagination, is equivalent to imaging, or thinking in 
images, as over against percei\ing — re-presentation as con- 
trasted with presentation. But the psychologist also differen- 
tiates between imaging which refers to some part of one’s past 
experience (memory) and imaging, which, though necessarily 
based upon this same material, presents the material in new 
forms or patterns, and which is not felt to refer definitely to 
some part of one’s past experience. This latter is imagination 
in the specific, or narrower meaning of the term. 

A further distinction is made between imagination which 
occurs under passive attention, as illustrated in reverie, musing, 
or dreaming, and imagination which occurs under active atten- 
tion, and which is marked by persistent, purposeful effort to 
dissociate former combinations of experience and to reorganize 
them into some new plan. We have, then, a distinction between 
I>assive imagination and active, creative, or productive imagi- 
nation. 

The tests of this chajder are designed both to secure indica- 
tions of the Wealth of spontaneous imagery in phantasy, and to 
measure capacity for creative or inventive thinking. 

In so far as intelligence denotes not merely good attention 
and good memory, but also inventive capacity, ability to plan 
and organize, to anticipate, or to ^‘put two and two together’’ 
(Ebbinghaus’ Jcomhinlcrcdde Tdtigkeit), in so far must the at- 
tempt to measure intelligence employ tests of productive imagi- 
nation and invention. It goes without saying that the tests 
here desci ibed do not exhaust the possibilities of investigation 
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in this important field of mental -activity. Undoubtedly, new 
tests will be devised which will prove of value in supplementing 
those heretofore employed. We need especially a series of tests 
of inventive capacity, of graded difficulty, which shall put less 
emphasis u[>on linguistic attainments. 

TEST 45 

Ink-blots. — In their discussion of a proposed series of tests 
for tlie examination of individual* differences in mental traits, 
Billet and Henri, in 1895, suggested that fertility of visual 
imagination might be investigated by means of a series of ink- 
blots. Two years later, but independently, G. Dearborn pub- 
lished brief suggestions for making a series of blots, and in the 
following year described the results of the use of 120 blots in 
the case of IG Harvard students and professors. ?>ince then 
Kirkpatridv has tried the ink-blot test with public school chil 
dren of 8 elementary grades; Hiss Sharp has followed the sug- 
gestion of Binet and Henri in a studj^ of individual psychology 
njK)n graduate students in Cornell University, and Pyle has 
published preliminary averages for different ages. 

The ink blot test is commonly classed as a test of passive 
imagination, under the assumption that 8 simply looks at the 
blot and allows his associative processes to suggest to him 
whatever ^pictures’ they may. In practise, however, 8 is quite 
likely to search actively for these associations, so that the 
mental activity concerned is, perhaps, more allied to active 
than to passive imagination. 

Materials. — Standard series of ink-blots, numbered from 1 
to 20. Stop-watch. Paper properly prepared for recording 8'h 
statements. 

The prininry diinciiKy heretofore existing in the application of the ink- 
blot test has been the lack of standardized material. To meet this diffi- 
culty, the author has prepared the series of blots just menti-oned by using 
zinc-block prints, so that investigators may now apply the same series 
of blots, and thus secure strictly comparable data. Unfortunately, this 
series has not yet been applied upon a sufficiently extensive scale to 
render it i)Ossible to publish norms of performance for the test. 

Method. — (a) Full procedure. Instruct 8 as follows: ‘‘1 
nave here a series of 20 odd-shaped ink-blots. I want you to 
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take them in order from 1 to 20, one at a time, to look them over 
at your leisure, and to tell me (or write down on a numbered 
blank) what things you can see in each blot. Try them in dif- 
ferent positions. Of course, these blots are not really intended 
to be pictures of anything, but I vrant to see whether your 
imagination will suggest pictures of things in them, just as 
you sometimes try to see what objects you can make out of 
clouds.’’ I^t S take his own time. Especially with younger 
aS^’s, it is better for E to record the results, so that S may be per- 
fectly free to enumerate as many things as are suggested to him. 

Kirkpatrick used ouly four blots, and allowed each pupil one minute to 
name as many associations as possible for each blot. Miss Sharp used 10 
blots, and allowed only 5 minutes for the (whole?) test. 

The test may be conducted with a group of by distributing the 
cards, and having them passed successively from member to member of 
the group until each 8 has written his associations for each card, but 
this method has obvious disadvantages. 

(b) Shorter procedure. Following the method used by Dear- 
born, arrange the 20 cards face down in a pile, with the 20th 
card at the bottom, the 1st at the top, and the numbered edges 
toward 8. Instruct aS' us follows : ‘^Each of these 20 cards has 
on it an odd-shaped ink-blot. When I say ‘now,’ turn over the 
first card in this way [illustrating the movement that will ex- 
pose the face of card No. 1 with the numbered edge toward ^]. 
Look at the ink-blot, ivithout turning the card in any other posi- 
tion, and say ‘now’ (or tap on the table) as soon as you have 
thought of something that the blot resembles. Of course, the 
blot is not really intended to be a picture of anything, but I 
want to see whether your imagination will suggest some ‘pic- 
ture’ in it, just as you sometimes try to see what object you 
can make out of a cloud.” Give Ihe command ‘now’; start the 
stop-watch at the same time. When 8 gives his signal, stop the 
watch, record the time and the object or association given by 8. 
Continue in the same manner with the remaining cards.^ 

^Tbe method proposed by Pjle (allowing 3 min. for writing the first 
thing suggested by each card in the order 1 to 20) is a modification of 
Dearborn’s method for the purpose of making group tests. It suffers 
from the defects already pointed out (Ch. II, pp. 8-11) as characteristic 
of tests in which speed is made a measure of performance, in which 
written responses are introduced and in which a time-limit instead of a 
work-limit is employed. 
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Treatment op Data. — In the full procedure, the score is 
based upon the average or total number of associatioiLs; in the 
shorter procedure,, upon the average speed of the single associa- 
tions. It is also possible to form some estimate/in either case, 
of the type, richness and variety of /S'’s imagery by classifying 
the associations afler some such plan as that illustrated below 
from Miss Sharpes results. 

Typical Results. — The following associations for the 20 
cards of the standard series are taken from the records of sev- 
eral adults, and will serve to indicate the variety that may be 
expected when the records of several ^^s are compared. Note 
the frequent reference to animals. 

(1) A lady seated on a couch. A witch riding on a new moon 
across the sky. A moose's head. A woman, sitting on a bank 
of shrubs, waving a handkerchief. Fir tree. Dragon in woods. 

(2) Child, crouching in fear. Man with grotesque features. 
Ugly old colored woman. Old man seated. Back of bear. Lion 
crouching. Tree uprooted, 

(3) A banner. A right-angled triangle. The God Billiken. 
An Egyptian idol. A jade-stone idol. A foot. Dog sitting on 
hind legs. Man shooting. 

(4) A large beetle. A boat load of excursionists. A lobster. 
A spider. Potatoes. A dirigible balloon of the Zeppelin type, 
with a cloud of steam or smoke overhead, and a grappling- 
anchor trailing below. Two trees and roots, stockings on 
clothesline. 

(5) A pig. A woman with a big head of hair. A butterfly. 
A hole through the ice. A girl wearing a tam-o-shanter cap. 
Human liver and heart. A rock. An oyster shell. 

(6) Woman running and holding her skirt. Woman with a 
muff in her left hand, and her hat almost blown off. A broken 
bellows. Merry Widow waltz. A dog on a post. An island and 
lake. 

(7) Large caterpillar on a horse's shoulders, A devil bending 
over something. An old man. A dream monster. A woman 
with flowers. Unicorn. Pig. 

(8) Human torso. Hot and cold water faucet in a bath tub. 
Pereon with head bent forward, holding sticks in her hand. 
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Heads of two birds trying to swallow what is between them. A 
frog. . A vase. Vertebra of back bone. 

(9) A goat with a pack on his back. A turkey with drooping 
V, ings trailing on the ground. A tree. A goose’s head. 

(10) Ugly man’s head. Head and arm of a woman with a 
lighted candle in her hand. A dachshund running off with 
some one’s cape. A mosquito pupa. A tree. 

(11) Map of Scotland and Ireland. Owl that has just placed 
a fish before him on the branch of a tree. Some specimen in 
geology. A tree blown in a heavy gale. A tiger under a tree. 
A conch shell. 

(12) Map of United States and part of Canada. A chicken 
lying on it»s back. An Indian head. A woman sitting on a 
cliff under a tree, reading a novel. A buffalo running. Hy- 
droids. 

(13) A tlying squirrel. The skin of a bear. A hen sitting on 
a nest. A dog running. 

(14) A crab. A bat with outspread wings. A moth. A neu- 
rological slide. A flower. An insulator. 

(15) Section of medulla oblongata. Two nuns bowing their 
heads together. A tulip. A false mask. A crab. Head of a 
fish. A plate of false teeth. A design-unit of two bears with 
heads together. 

(16) Closed hand with thumb and little finger, or a sixth 
finger, projecting, A loving cup. A tea-pot. A head. 

(17) A root. A porcupine. An Indian head. A nerve cell. 
Sponge dropping water. 

(18) A Chinese dragon, as seen on packages of fire crackers. 
Branch of a gnarled oak. A lizard. An old woman and child. 
A man with knees bent. 

(19) Bird alighting on a nest. A flying squirrel. Bear of a 
cat in rapid motion. A lamb. A duck. 

(20) Man pulling off his sweater. Runner leaning forward 
to start a foot-race. Photographer, with focussing cloth over 
his head. Crocodile suspended by the head. Bear with the 
grandmother’s night-cap and gown, as illustrated in Little Red 
Riding Hood. An elephant seated. 
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General Results. — (1) Speed of association. In 1920 trials^ 
Dearborn found the average time for making a single associa- 
tion to a blot to be 10.3 sec. This seemingly long time may be 
due to the difficult nature of some of the blots in his series. 

The children aged 8 to 14 tested by Pyle with the author’s 
blots, but with the written response, averaged from 6.4 to 12.0 
responses in 3 min. Ilis adults averaged 10.6 for the men and 
9.8 for the women. 

(2) Dependence on age. Kirkpatrick states that ^^younger 
children seemed more suggestible or imaginative, as they named 
more spots” (Table 128). Pyle’s tables show a similar tendency. 


TABLE 128 

Average Numher of ^Names' Given to Ink-Blots (Kirkpatrick) 


GRADE j 

I 

II 

HI 


V 

VI 

VII 

vin 

Average 

2.9 

2.5 j 

2.6 

1.8 

1.9 

1 

1.7 

2.1 

2.2 


II is evident Unit something besides a simple decline of ‘imagination’ 
with age is exhibited in (his table. In explanation, Kirkpatrick says : “The 
younger children seemed to have no doubt whatever of the spot being a 
picture of the object they named, while the older children simply said ‘it 
is some like’ or ‘it looks a little like,’ ‘a dog,’ ‘cloud,’ or whatever else 
was suggested. This superiority of the small children is striking when 
we consider that tlie number of mental images that they have is much 
smaller than that possessed by older children, who may name a i)art of 
the body or the mai) of a country or something else that the younger 
children know nothing about 

“The smaller number of objects seen in the spots by the children of the 
4th, 5th, and Gth grades is probably to be explained by the fact that 
children of those ages have become more critical in their sense-perception, 
as their ideas have become more definite, and as they have learned from 
life’s experiences and from training to be more careful in their judg- 
ments. The older pupils of the 7th and 8th grades,„on the other hand, 
have passed into another stage in which they realize that a picture is 
iiot necessarily this or that, but may resemble any one of several things, 
hence they are not afraid to say w^hat it looks like.” 

(3) Dependence on occupation. Dearborn believes that, at 
least in maturer 8% the results of the ink-blot test are condi- 
tioned, not so much by age or sex directly, as by habits of living, 
occupation^ ^nd other environmental factors: thus, we should 
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expect characteristically different results from the test when 
applied, for example, to artists, farmers, laborers, professional 
men, to the city-bred or the* country-bred, etc. 

(4) Dependence on race, Pyle’s averages (5b) show that 
negroes are nearly as good as whites in the ink-blot test. 

(5) Individual differences, both in speed, number and type 
of association seem to have been been clearly marked and fairly 
constant, whenever the test has been applied. Thus, in Dear- 
born’s single-association method, the higLest agreement in the 
answers of his iS^’s for any one card was but 40 per cent., while 
for several cards, no two ^’s gave the same answer. 

As regards fertility of imagination, Miss Sharp noted that 
the most in^ginative S in her group saw 81 objects, the least 
imaginative but 27 objects in the same 10 blots. The same in- 
vestigator believes, however, that all S’s might be roughly di- 
vided into two groups, (a) the constructive or imaginative, 
who put together concrete details ^4n such a way as to form 
a significant whole,” and (h) the matter-of-fact, or scientific 
type, given more to analysis than to creative synthesis.^ 


As examples of this cUffereiice, the following rej)orts from two of Miss 
Sharp’s may be quoted: both refer to the {‘•ame blot. 

(1) Associalious feio and n07i<‘(jnslnutive, “An eagle. Stuffed tur- 
key. Head and neck ot a minsk-rat.” 

(2) Assoviations numerous and constructive. “Giraffe. Prehistoric 
bird ill flight. Fairy riding on a bumble-bee. Bit of tropical Jungle, with 
trailing gray mosses and pools of water. Jai)anose lady. Itit of land- 
scape with two hills and a valley between — an army eucam])ed under one 
hill. Moss-grown log floating in water. Fabulous monster (griflin per- 
haps) walking off on his hind legs with a small lloiientot under his 
arm.” 


(6) Qualitative classification, Tt is often possible to classify 
the associations peculiar to a given 8, Thus, Miss Sharp men- 
tions as classificatory groups: {a) common-place, every-day 
objects, such as domestic utensils, tools, plants, and ]>articu- 
larly animals, (b) scientific objects, such as geometric figures, 
schematic drawings, (c) objects suggested by literary remi- 
niscence, and (d) objects from fable and mythology, such as 

*It is tempting to regard this classification as identical with the com- 
mon classification of laboratory iS’s into ‘subjective’ and ‘objective’ ob- 
servers. 
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centaurs, dragons, witches, fairies, etc. Some /Sf^s exhibit va- 
riety of association, in that they cite objects that belong to 
several of these groups; others are ibuch less fertile in imagina- 
tion and confine themselves largely to a single type of imagery. 
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TEST 46 

Linguistic invention. — The ink-blot test serves primarily as 
a test of visual imagery. But an even more fruitful source of 
individual differences in creative ability may be found in lin- 
guistic invention. Miss Sharp, acting upon the suggestions of 
Binet and Henri, tested what she terms ‘literary imagination,' 
in three ways, viz. : by the development of sentences, by the de- 
velopment of a given theme, and by the choice of a topic for 
composition. 

The idea of preseuliiig a number of words to be joined into 
a sentence has been elaborated in various ways. The assign- 
ment of three words was employed by Masselon in 1002, and 
this test has, on that account, been referred to by some writers 
as the “Masselon method.’^ It forms one test in the well-known 
Binet-Bimon series, and was one of the tests used by Miss Sharp 
in her investigation of the mental types of adult ^’s. The re- 
duction of the number of terms supplied, to two has been 
strongly recommended by Meumann, who selected the two terms 
in a special manner (see below), while another variation of 
the two-word test has been tried by Burt and by Wyatt, in 
which 8 is given a series of 10 words to be joined together suc- 
cessively, by pairs, in a series of sentences. On the. other hand, 
the number of terms has been increased to 5, 8 or 10 with the in- 
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struction to invent a story containing the prescribed words 
(invention of stories). This method evidently stands midway 
between the method of sentence-formation and the method of 
development of a theme, while by a little further extension the 
well-known Ebhinghaus completion method (Test 48) is 
reached. It needs little reflection to understand that the 
nature of these vavious tests becomes decidedly varied as the 
number and nature of the supplied terms is varied. 

The method of completing a prose passage in which a large 
amount of Ihe original text is supplied is embodied in Test 48. 
The pr(‘S(‘nt lesi includes the me! hod of sentcmce-formalion 
known as Masselon’s medhod. the meihod of sentence-formal ion 
devised by ^rmimann, Ihe (H)m]>letion of sentences used by Binet, 
the invention c»f si cries, and Ihe dcwelopment of a theme. 

Before undertaking these formal tests, however, it is desir- 
able, if the pur])Ose in mind is to make a qualitative study of 
the mental type of individual >8’s, to institute a preliminary 
inquiry concerning the general literary tastes and habits of 
each S, The exact nature of this inquiry must, naturally, be 
adapted to the age and training of the >8’s: the following are 
some of the points that have been covered by investigators: (1) 
list of favorite books, (2) statement of favorite type of reading, 
fS) statement of the magazines, periodicals, newspapers, etc., 
ordinarily read, (4) list of books (outside of classroom or pro- 
fessional work) read during the last year, (5) statement of 
favorite games and evidence of enjo^mient of games, like chess 
and checkers, that demand creative activity and foresight, (6) 
fondness for Ihe tlu^ater, drama, music, ]>ainting and othei 
forms of art, etc., (7) experience in creative literary work 

A. sentlnce-foumation (masselon method) 

Method. — Ask S to write as many sentences as possible con- 
taining the three nouns : cithen, horse, decree* Each sentence 
must contain all three nouns, though it may contain others as 
well. The sentences are to be as varied as possible. Five min- 
utes are allowed. Continue the test with four more sets of 
nouns, and afterward make similar tests with five sets of verbs. 
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For the noun tests, use as additional sets: (2) hell^ ground^ 
owner, (3) skill, modification, picture, (4) cup, fraction, money, 
(5) letter, law, summer. For verbs use (1) Mess, destroy, ^ 
write, (2) make, correspond, remain, (3) require, choose, run, 
(4) see, find, throw, (5) remenibcr, put, depart. In the noun 
tests, 8 is permitted to use either singular or plural forms, and 
possessive as well as nominative or objective cases; in the verb 
tests, he may use any form of the given verb, e, g.. Messed, to 
Mess, will Mess, etc., as well, as Mess, 

The tests may be conducted with individuals or with groups; 
but it is preferable, especially with young ^S'^s, to work indi- 
vidually and to let 8 dictate the sentences instead of writing 
them. 

Treatment op Data. — The quantitative score is determined 
by averaging the number of sentences written by 8, The qual- 
ity of work may be graded upon any convenient scale, e. g., 1 to 
5, corresj]onding to five degrees of excellence. Miss Sharp used 
the symbols A, B, and C, and indicated intermediate grades by 
the. use of — and -[-• For purposes of computation, she then 
assigned numerical values to these symbols, as follows: A — 
= 40, A = 50, A -f = 60, B— — 80, B -- 100, B+ — 120, C— 
160, C = 200, (7 + = 240. In practise, this scoring is vir- 
tually equivalent to estimating quality of work in terms of aver- 
age number of words per sentence, and that simpler method 
may be used for the qualitative score. 

Typical Results. — (1) The following are selected single seif- 
fences reported by Miss Sharp for the first test : 

1. “Decrees are made for citizens, not for horses.” (I'he connection 
of the words here is simple and mechanical.) 

2. “That stalwart citizen on the great gray horse is a man to bo 
trusted with the decree.” (This implies a concrete situation.) 

3. “All the well-to-do citizens of the viliage, each mounted on a horse, 
rode through the streets, proclaiming their dissatisfaction with the new 
decree.” (A situation is here more fully outlined.) 

(2) The following is a full set of sentences written by a 
graduate i^udent, in 5 min., for the first assignment : 

1. A decree was posted that the citizen should not abuse the horse. 

2. The horse of the citizen was sold by official decree. 

3. “Here,” said the citizen, “is the horse mentioned In the decree.” 
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4. Early In Arabian history, a decree raised to a higher caste, a citizen 
who owned a horse, but later, possession was sufficient for better stand- 
ing, and the law was not needed. 

5. . If a citizen keep a horse, it is a decree that he use it kindly. 

6. *‘What a funny decree,” exclaimed the citizen, when he read of 
the horse sun-bonnet law. 

7. The decree was signed that the horse had kicked the citizen, and 
therefore the injured man could collect damages from the owner of the 
animal. 

8. “Time is up,’^ cried the citizen, stop-watch in hand, “I hereby decree 
that you write the word horse and stop^ at once.” [Faulty on account of 
the use of ‘decree* as a verb.] 

(3) The following represent groups of sentences written for 
the author by two college students (selected at random from a 
number of papers) for the fourth set of verbs. The relatively 
greater variety of the second group is clear. 


A. 1. “I saw the book and tried to find a place in which to throw it.‘* 

2. “I threw the cat in Zhe creek and turned to see if anyone had found 
me out” 

3. “I see that I can find nothing to throw at him.” 

4. “You see, it was this way, I simply found the hatchet and threw it.” 

B. 1. “The child saw a horse, found a stone and threw it at him.** 

2. “When you find a clover, see if it has four leaves : if not, throw 
it away.’* 

3. “Throw the paper out of the window and see if it w ill find a good 
landing place.” 

4. “Find me a pencil, then I will see if I can find out the solution to 
the problem which is on the paper that yon threw into the basket.’* 

5. “The boy found an apple, but when he saw it was decayed,, he 
threw’ it aw ay.” 

Conclusions.^ — (1) Dependence on part of speech assigned. 
All 8^’s tend to wu*ite fewer, but better sentences with verbs 
than with nouns. 

TABLE 129 

Scores of Seven Adults in Developing Sentences {Sharp) 



QUANTITY OP WORK 

QUALITY OP WORK 

FORM OF TEST 









Mmimiim 1 





Average 

Maximum j 


Aver ige 

Maximum 

Minimum 

Noons ‘given’ 

4.6 

6.6 

3.2 

79 

113 

55 

Verbs ‘given’ — 

8.8 

5.8 

2.5 

93 

133 

54 


^hese are all drawn from the work of Miss Sharp. 
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(2) The rank of 8% both in quality and quantity of work, is 
the same when nouns and when verbs are assigned. 

(3) ‘‘In general, the vSiibjeets who made the most sentences 
made the most elaborate, and those who made the fewest sen- 
tences made also the simplest and most unimaginative.’^ 

(4) This test correlates with the ink-blot test, in so far as 
those S’s who show most constructive capacity with the blots 
also show most constructive capacity in the development of sen- 
tences. 


B. SENTENCE-FORMATION (mEUMANN^S METHOD) 

The Masselon method, according to Meiimann, is less well 
fitted to bring out differences in intelligence than his own 
niethod of presenting but two w^ords, so selected that a number 
of different relations can be worked out betw^een them, only one 
of which, or at least only a few of w^hich, can be regarded as 
being really appropriate, pertinent and sufficiently definite 
as to evince good sense and a real appreciation of the relation. 
This appropriate combination of the tw’O words into a sentence 
is accomplished only when 8 introduces a third relational ele- 
ment that supplies the ‘point’ needed to round out the thought. 

Method. — Explain to 8 that he is to make a sentence with 
each pair of words. By the aid of illustrative examples make 
it clear that there are two ways in which any pair could be 
joined, the one correct enough, perhaps, but banal and loose, 
the other logical, sensible and specific, and that the latter form 
is the one desired. For example, the words snow — melts could 
be rendered as “The snow melts” or as “Snow melts when the 
w^arm sun shines on it.” Again, the words square — sides could 
be rendered as “A square has sides” or as “A square has four 
sides of equal length.” Similarly, from the pair automohiles — 
tires could be obtained “Automobiles have tires” or “Auto- 
mobiles have pneumatic tires to make them ride easily.” 

When these instructions have been grasped, give /S the fol- 
lowing 10 pairs of terms and allow him all the time he desires 
.to write one sentence of the ‘pointed’ type for each pair: (1) 
donkey — ^beatings, (2) soldiers — country, (3) city — streets, 
(4) sun — noon, (5) pine — winter, (6) drink — poverty, (7) 
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cat — punisUed, (8) sky — red, (0) water — hill, (10) ieiKher — 
pleased.- 

Results. — The following tyi^es of answers may be readily 
distinguished 

(a) The dictated words arc written, but nothing else. 

(h) The given words are joined in a nonsense statement, o. //., 
“The city is a -street.’’ 

(c) A number of successive sentences are cast in a very sim 
pie form whicli is the same in each, c. g,, donivey has beat- 
ings.” ^‘Soldiers have a country.'' cliy has streets. 

(d) The written statement is incorrect, but such as to sug- 
gest that aS' had the glimmerings of an idea that failed of ex- 
I>ression, possibly on account of some difficulty in the use of 
language, c. g.^ ^‘To drink is poverty’.” 

(e) The •sentence is logically correct, but indefinite, too 
loose, general and banal, c. g,y ^^A city has streets.” 

if) The words are combined into a specific statement, but 
one that is imaginative and not expressive of the correct con- 
nection, c. tr/., ^^Once upon a time there were three soldiers who 
lived in a beautiful country.” 

ig) The sentence is definite, logical, correct and pertinent, 
embodying the right causal connection, c. g., ^^In the city the 
streets are wide and paved with brick. “Good soldiers are 
ready to die for their country.” 

Notes. — The ^sentence-construction^ or ^sentence-formation’ 
test used by Wyatt and by Burt consists in j)rcsenting a series 
of 10 words such as circle^ moon, nighty sleep, etc., each one of 
which is fairly obviously connected with the next and then 
allowing each ^ 2.5 min. to write a series of sentences connect- 
ing the successive terms by jiairs, e, g., “The full moon has the 
form of a circle.” “The moon shines at night,” etc. Particular 
stress is laid upon the condition that the various sentences 

"The last .two have been supplied by the author to replace less useful 
or more cxnnplex combiiiations in Meumaim’s list. 

^Although Mciiuinuii concludes that any attempt to score this test 
quantitatively must be arbitrary, it would seem possible to attempt some 
numerical comj)arison of the work of different jS'’s.by assigning a scale of 
marks, like 0, 1, 2, etc., for these seyeral qualitative degrees of perform 
mice. 
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must show the ^^closest possible connection;” In practise this 
instruction is difficult to make clear, and the performance of 
iS’s is quite difficult to score precisely or fairly. The time con- 
sumed in writing also enters as a disturbing factor. Burt found 
for this test a coefficient of reliability of only .Gl, but a fairly 
high correlation with intelligence, 0.G2. 

C. COMPLETION OF SENTENCES 

Materials. — rrinted forms containing beginnings of 25 sen- 
tences,^ with spaces for the completion of each sentence. Piece 
of white cardboard. Stop-watch. 

Method. — Give ^ the following instructions: ^^On this paper 
there are printed the beginnings of a number of sentences. I 
am going to show these to you, one at a time. As soon as I show 
you one, I want you to finish out the sentence. You may say 
anything you want to, as long as the whole sentence will make 
sense when you have finished it. Take an easy attitude tow'ard 
the test. Boirt try to hurry. Let the completion of the Sen- 
tence develop naturally and freely, wdiether it is long or short." 
If ^ fails to understand what is w’^anted, supply him wdtU an 
extra paper on which a few trial sentences have been written 
in pen and ink, and show’ him how they might be completed. 
For the test proper, cover the entire test-blank with the card- 
board ; after a warning heady,’ expose the first incomplete 
sentence.^ Start the watch at the same time. Record as 
nearly as possible the time used by in starting to complete 
the sentence, i. e., the time he takes, after he reads the sentence, 
to ^get an idea.’ The timing should be done without S'^s knowi- 
edge. 

Variation of Method. — The printed forms are arranged to 
permit written tests, either of individuals or of groups. With 
groups the timing ma}’ be omitted w^ithont serious detriment. 

^The ftrst 20 scnteiu*es are taken, with such slight nio^iOcatioiis as 
translation lias snggcslod, from Hinot. The last five (since Binet prints 
hut 20 oT the 25 he recommends) have been supplied by the author. 
Other sets of incomplete sentences will be found in WeidensaU or in 
^VoolIey and Fisclier. 

'The sentences have purposely been numbered fiom the bottom of the 
page, so that the cardboard will not interfere w ith /?*s writing. 
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Some )S’s give shorter, others longer sentences when they are 
written, 

TrUtatment op Data. — Compute the average, or determine 
the distribution, of the times needed by to start the 25 sen- 
tences. For a qualitative index, estimate as well as possible 
(preferably by using some such system of scoring as that de- 
scribed in the development-of-sentences test) the general value 
of the completed sentences. /S^’s sentences may also, if desired, 
be classified in regard to type, e, vague or meaningless, com- 
monplace, reminiscential, imaginative, apiioristic, etc. 

A more elaborate system of scoring was attempted by Woolley 
and Fischer and followed by Weidensall in part. Records were 
kept of (1) number of sentences attempted, (2) .number of 
sentences correct (in the sense of constituting a real sentence, 
even though there might be some mistakes of grammar), (3) 
number of simple and of complex sentences, (4) average num- 
ber of words written per sentence, (5) number of ideas expressed 
in the sentences, taken collectively (scored by a somewhat 
complex set of rules), (6) total time used in the test, (7) time 
used to start each sentence (classed in live groups, 0-2, 3-5, 6-10, 
11-20 and 21-60 sec.), and (8) 4ndex^ of ideas, obtained by 
dividing (6) by (5). Use is made in the published results, 
liowever, of only the 2d, 5th, 7th and Sth of these scores. 

Results. — (1) Binet found characteristic differences in the 
$peed of nprlc of his two daughters, Armande and Marguerite. 
Thus Armande’s records show 12 sentences started in less than 
5 sec., 4 sentences in from 5 to 10 sec., 6 in from 10 to 20 sec., 
1 in 28 sec., and 1 in 70 sec. Marguerite’s records, on the other 
hand, show but 1 sentem e started in less than 5 sec., but 7 sen- 
tences in less than 10 sec., and the remainder in much longer 
limes, c. jr., 20, 50, and 70 sec. 

(2) Binet’s two >8’s also showed characteristic differences in 
the type of sentence-completion:. Armande is poetic and imagi- 
native; Marguerite’s sentences are more precise, more practical, 
more in accord with real life, less emotional. For example, for 
Sentence 1, Armande writes: entered the field by a covered 

footpath.” Marguerite writes: entered the grocery and 

bought two cents worth of chocolate,” 
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(3) The study of school children at Cincinnati by Woolley - 
and Fischer brings out the following points: (a) age is a factor 
of vsoine moment, since 15 year old pupils, when compared with 
14 -year-okl, show a decided improvement in number of correct 
sentences^ a large increase in number of ideas expressed and a 
slight increase in the speed of beginning the sentences; (h) sex 
differences seem to favor the boyg, who are somewhat superior 
1o girls in correctness and somewhat quicker than girls in speed 
of beginning (there was no definite sex difference in number of 
ideas) ; (e) the test shows a large positive correlation Kith 
school grade attained by both sexes at both years, when per> 
formance is scored by any of the three measures — number of 
correct sentences, number of ideas or speed of response. 

(4) DeUnqaentB- The results obtained by Weideusall with 
Bedford lieformatory women show that they are slower to 
respond than the Cincinnati girls, slower even than the Cincin* 
nati retarded girls. On the other hand, the number of correct 
sentences and the number oC ideas expressed were, contrary to 
ex})ectation, greater in the Bedford group; this outcome may 
be due to the conditions under which the Bedford Women w^ere 
tested, or it may be connected, one may surmise, Avith the 
longer time taken in starting the sentences. At Bedford the 
ability to make correct sentences did not correlate with school 
grade attained before entering the institution, but the speed 
with w'liich the sentences w^ere started did correlate with the 
school grade; in fact, the poorest took five times as long to 
start their sentences as did the more intelligent ones. 

D. INVENTION OF STORIES 

T( st No. 2(\ of the Binet'^imon 1905 series called for the con- 
struct ion of a seuteuce coutaiiiiug three specified words. This 
test has been elaborated by Mrs. Squire by asking not for a 
sentence, but for a storg about thi*ee words. The same test, 
with 5, 8 or 10 words given,- has been used by Winch in his 
comparative study of memory for ideas and productive imagi- 
nation. 

Meumann's somewhat similar test consists in dictating a 
•series of cue-wordsLoiiphrases,„ carefully selected as to nature 
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and number, with the instructions to make a story from them. 
In this test the principles involved in selecting the words make 
the problem of a different sort from that invol^^ed in Winch’s 
test ; the conditions are rather more rigorously drawn, so that 
the number of satisfactory solutions is smaller. In some re- 
spects, in fact, IMeumann’s tost more nearly resembles the 
Ebbinghaus completion method (Test 48) 

Method. — (1) For young /S’s, ask for a story about a haij^ ii 
river and a hall (Squire test). For children younger than 10, 
and better for yet older children, the story should be given 
orally and taken down verbatim by L\ 

(2) Winch’s instructions, as giv'en in writing to a group of 
i3-yoar-old >S”s, were as follows (8^ p. 102) : 

^‘Write a story containing the following words: thief ^ land- 
lord^ crahy sJiaJx'c, hotels basket , cries, provisions, escape, ciistodiji 

^Wou are to write the longest story you can, because the 
longer the story is, the more marks you will get, provided that 
everything you write has something to do with the story. You 
will get no marks at all for them and only be wasting your time 
if you write sentences which have no connection with the rest. 
Try and think out the story you are going to write before you 
start, and see that the progress of the story will enable you 
to fit all the words in properly.” 

It is desirable to make more than one test of this sort. For 
this purpose, use may be made of one or more of the other lisi.sf 
of terms used by Winch® with the same instructions as above. 
These lists are: (1) Orphan, garden, liungrg, station, parents, 
clothing, visitor, cottage, train, country. (2) Snowstorm, chil- 
dren, ticket, clock, dog, screams, church, basket, river, ice. (3) 
Army, hill, artillery, victory, cavalry, fight, captured, brave. 
(4) Foi\ younger children (8-9 years) : dog, clock, basket, man,, 
children. 

(3) For Meumann’s test E must take a simple connected bit 

•It should be said that Winch’s Invention tests were applied to chil- 
dren who were also being tested in ‘substance memory’ with the aid of 
passages containing terms quite similar to those given as material for 
the Invention. This had undoubtedly an effect upon the invented stories, 
though Winch asserts that “the invented stories are, almost invariably, 
on a much lower plane” (p. 101). 
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of prose depicting a total situation and reduce it to a series of 
salient cue-words. After giving one or more preliminary illus- 
trations, ^'’s are requested to write a story based on the cue- 
words selected. The following is the set most successfully used 
by Meumann : house took fire — child alone — clever monkey — 
parents fhankf ill — rcicard. 

No time limit is set in any of these tests. should not be 
hurried. 

Treatment of Data. — Mrs. Squire contented herself with re- 
c<u*ding four degrees of performance in her three-word test: {a) 
romplcte failure, (h) separate sentence given for each word, 
i c) three words in one sentence, but the sentences [of the rest 
of the story?] unconnected, and {d) complete narrative. The 
outcome of this scoring is indicated below. 

Winch scored performance on the general basis of number of 
meaningful hinits’ in the story, giving no allowance for any 
sentences or parts of sentences which did not arise connectedly 
from preceding sentences, but yet no penalizing for lack of 
esthetic unity (making every element in the story converge to a 
j»oint). The aim is to rank the performance with regard to the 
‘fertility of continuous and conriected imagination*’ displayed 
in it.^ 

Eesults. — (1) Dependence on age is shown in Mrs. S(piires' 
results in the form of (a) ^^a development from the crude sen- 
tence strung together by ^ands’ to a closely knit sentence," 
while {h) ‘^another characteristic change is the transition from 
the fantastic type of story related by the 6, 7 and S-year-old 
children to the extremely realistic, matter-of-fact style emi)l6yed 
by the 9th, 10th and 11th year groups,” and (c) ^^aiiother plan 
of invention, more flexible in style is evident in the stories of 
the 12th and 13th year groups.” 

As applied in her mental age series, this test becomes roughly 
diagnostic as follows: Ihc normal G-year-old can give orally 
sentences containing the three words; ability to get all three 
words into one sentence, though with a disconnected story, 
would appear typical of 8 and 0-year-old children (though given 
by Binet as a 10-3^ear test) ; ability to construct a complete 


’See his discussion, pp. 102-105, for further details. 
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narrative as a realistic type is seen in the 9th and succeeding 
years, with a final level of flexibility and superiority of style 
appearing at 12 and 13 years. 

(2) Cprrelations. Winch found moderately high correla- 
tions, .55 to .75, between substance memory and the invention 
of stories, and that practise in substance memory, unless car- 
ried to the ^fatigue-point’ (limit of trainiijg), tends to augment 
proficiency in invention. 

(3) ReliaMlitt/. The reliability of the test, as might be 
anticipated, is not very high, about .50, so that more than one 
trial is demanded for significant results. 

(4) Qualitative differences. Meuniann found it somewhat 
difficult to score the work of school children in such a way as 
to distinguish fine degrees of intellectual ability, but he consid- 
ers the elaboration of the story from the cue-words a good test 
for revealing larger differences in general mental ability and 
also for revealing'various mental types. In general, he finds 
tight fairly distinct types of story. 

(a) Zero perforiimiico ; connections between the cue-wortls lacking or 
nonsensical. 

(h) Tlie ciie-wonls are connected in a nnnjlxT of separate and inde- 
pendent sentences. Here the grade of mental ability is siiflicient to join 
together pairs of terms, but not to make the larger synthesis of all (he 
terms into* a whole. 

(c) Attempts are made to iwodiice a whole, but the connections be- 
tween the various cue-words are not rightly arranged and the point of 
the whole story is not grasped. 

(cl) The connections between the cue-words are rightly arranged, 
but the point of whole scries of words is missed and the result is a story 
of a totally wrong ‘turn.’ 

Types a-d may be regarded as all indicative of lower stages of in- 
tellectual ability : the following four types, however, may be regardect 
ns solutions of the iiroblem. though of different kinds. 

(c) The pure hnopinative type is illustrated by a story of astonish- 
ing richness of detail, with decided linguistic fluency, but with the real 
point either quite lost or badly distorted. S’s of this type evince, then, 
little intelligence, but a rich imagination; their endowment is perhaps Ex- 
clusively linguistic. 

if) The pure intellectual type is illustrated by a story in which the 
connections of the cue-words are correct and the point of the whole is 
correctly grasped, but its elaboration into a story is accomplished In the 
scantiest manner possible. 8 is content to j)resent the logical and fact- 
ually correct connection of the cue-words In the shortest possible manner. 

(j 7 ) The imaginative-emotional type is illustrated in stories that show 
e\ident presence of feeling, to give due expression to which 8 Indulges 
in active imagination. He introduces invented details to express his 
emotional reaction. 

(fc) The intellect wal-imayin4tive type is illustrated by stories that 
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show cleat grasp of the meaning of the whole suppleiiici\tod by imagiiia* 
tive’ and pictorial additions, which are, however, always pertinent and 
subdued to the salient points in the development of the story. 

For examples of these several types, consult Meinnann (i^p. 158-0) : 
a single one of them, that of Type f, may be repeated here : * 

Story of Arthur W., 7th school year, age 12 years 9 months: 

“There was a house in the village : it took tire. The parents had just 
gone away. The child was all alone in the house. The people also had a 
clever monkey. He saved the child from the flames. And when the 
parents came home and saw that the monkey had saved the child, they 
were thankful and gave him a reward.” 

E. DF.VEI.OPMENT OP A THEME 

Method. — Supply S with writing materials^ and give him 10 
min. (or perhaps longer if working Avith young aS's) to write 
upon some theme selected from the following: (1) The Death 
of a Dog, (2) The Capture of a Fortress, (3) The Escape of a 
Priso}i€r, (4) A Forest Fire, (5) The Missloit of Music, (6) The 
Influence of Newspapers^ (7) The Delays^ of Justice, (8) A Trip 
in a Flying Maehiney 

Treatment of Data. — ( iuanlity or speed of work may be 
reckoned Avith approximate accuracy by counting the number 
of Avords Avritteu in the assigned time; quality of Avork, Avhich 
is really important, especially in the treatment of imaginative 
themes, must be estimated by E after a trial has shown Avhat 
may be deemed poor, and Avhat good work for /8’s of the age 
under investigation. Quality may be recorded in the manner 
already described, or upon the basis of 100, as in grading school 
compositions. 

Results. — (1) The relatiAe number of Ideas elaborated by 
different is indicated Avitli fair approximation by the rela- 
tive number of Avords Avritten, so that number of Avords may 
stand as a fair index of fluency of ideation and general lin 
gnistic readiness. 


‘^The fli’.st of tlicse themes was used hy Bhiet in his comparative study 
of the mental processes of liis two daughters; the next six were used 
for a similar purpose in ]Miss Sharp’s study of university students — the 
first three of them being designed to inA’oh’e imaginative, the second 
three expository treatment; the last theme is suggested by; the author 
as more suitable for younger >S''s. To secure a more reliable 'estimate 
of S"s efficiency it is desirable that more than one theme should he de- 
veloped. 

• This test lend.s itself readily to group treatment, since it Involves a 
familiar type of school activity. 
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(2) As a rule, mon*e words are writteit upon imaginative than 
nj>on expository themes. Sharp's best S wrote in 10 min., on 
nil average, 259 words iiimn imaginative, and 222 upon exposi- 
tory themes; her poorest >S' wri>t(‘, on the average', 124 and 9i 
words, respe( tiv(‘ly, tor tin' sann* types of themes. 

(1) Those aS’s tliat show eonsirnetive ability in the ink-blol 
lest, and in the dc'vc'lopment of sentenees, also exhibit the same 
superiority here in the development of themes. 

Notes. — These tests of linguist k- invention might, without 
great dillitailty, be ))aralleled in other fields of const rmdive 
e|fort. A test of musical ability (of the creative sort) might, 
for example, be devised by asking N's to tinisli a partially given 
musical theme, or to construct a simjile melody from a given 
series of notes. Similarly, certain forms of artistic invention 
might be tested by asking aS's to sketch designs for wall-pa}>er 
or j)at terns for Venetian iron-work. 

^fiss Shar[)'s test of the choice of a t Inane was conducted l>\ 
asking aV's to select, from the following It) tliemcs, tln/se liv(‘ 
upon which they would pri'fer to write, if asked to do so: A. 
Imaginative themes, (1) In a SHOirstorm , (2) .1 l*oJ(n' Land- 
scape^ (1) A. rnrilan Sffhlntlh, (4) .)/// Opposite Sei(/hb<n\ (5) 
Man Endoired iciih the Poa er of PJit/ht : U. ICxpository themes, 
(0) Civitization }(of l\e(/eneration , (T) Wisdom in Chari tjj, (St 
Friendship of Poohs, (9) Fiction as a ]'eJiicle of Truth ^ (ID) 
The Eloquence of the Pur and that of the Pulpit. Tin' exjmsi- 
tory themes were generally jireferred, but some aS's, who, as 
other tests showt'd, had little capacity to handle imaginativt' 
themes, did seh'ct seMoal from th(‘ latter division. 

iii:Fl>UKNri:s 

(1) A. liinet oL llcnri. La nsycholo^io bHlividuollo, AuPs, 2: 
isor) (IStHp, 411-4or». especially 441. 

(2) A. Binet, L’Ctiule exijcriinentale do riiitelligence, Paris, 1002. 
Pp. .300. Especially oil. x. 

(3) C. Burt, E.xpcriinental tests of lii^lior mental processes and their 
relation to j^eneral intelligence. JfJPd. 1 : 1011, 0.3-112. 

(4) K. !iMasselon, Psycholojiie des dements i»rei'Oces. Paris, 1002. 

(5) E. Meiimann, Ueber eine none ^letbode der Intelli^eir/.prufum? 
nnd liber d*‘n AVert der KombinationsimThodon. ZP<JPs, 1.3: 1012, 140- 
1(13. (Also Vorlesnmren znr lOinfiihruniren in die experimentidle Piida- 
j^'ogik, 2d ed., Vol, 2: 1013, 143-452.; 
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<f») Stella E. Sharp, Individual psychology: a. study in psychological 
method. AmJPs, 10: 1899, 329-391. 

(7) Carrie li. Squire, Graded mental tests. JEdPs, 3; 1912, 363-380^ 
430-443, 403-500, especially 439-441. 

(7a) Jean Weidensall, The mentality of the crimipal woman. To 
appear in EdPsMon. 

(8) W. II. Winch, Some relations between substance memory and 
productive imagination in school children. BrJPs, 4 : 1911, 95-125. 

(8a) Helen T. Woolley and Charlotte R. Fischer, Mental and phys- 
ical measurements of working children. PaMon, 18: 1914, No. 77. Pp. 
247, especially 185-212. 

(9) S. Wyatt, The quantitative investigation of higher mental in*oc- 
esses. BrJP^ G: 1913, 109-133. 


TEST 47 

Word-building. — The word-building test was suggested by the 
familiar game of anagrams, as well as by the advertisements 
often seen in magazines in which a prize is offered to the person 
who can make the most words from a given word or series of 
letters. This test is easily administered and evaluated; it is 
one that calls for ingenuity and active attention ; it might fairly 
be said to demand that ability to combine isolated fragments 
into a Avhole, which Ebbinghaus has declared to be the essence 
of intelligence and for the measurement of which he devised 
his well-known Completion method’ (Test 48) ; and finally, its 
execution is conditioned to a certain extent by the richness 
and readiness of the examinee’s word-vocabular3\ One may 
expect, therefore, to find a correlation between this test and the 
vocabulary test (No. 50), and possibly between it and school 
standing or general intelligence, and other tests of creative 
literary ability. 

In addition to the preliminary reports made by the author, 
the two tests proposed by him have been tried out by Pyle, 
Squire, AVyatt (with some modification) and most recently by 
Anderson, in an extended aj^plication to several hundred public 
school children at Ithaca carried out under the author’s direc- 
tion for the purpose of supplying curves of percentile distribu- 
tion for /performance in several tests. Heymans and Brngnians 
have used a, similar test (making as many words as possible in 
10 min. from a given 10-letter word) in their study of the inter- 
correlatioiis of various tests of intelligence. 
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Materials. — Two specially prepared blanks, the first of 
which calls for combination of words from the letters a, c, o, b, 
my ty the second from the letters Cy a, iy Ty ly p. 

Method. — Provide S with the first test blank, and give him 
the following instructions: ^^Make as many words as you can 
from the six letters given on this blank. You may use any 
number of letters from one to six, but no letter may be used 
• twice in the same word, and no other letters than these six 
are to be used. You will have five minutes.'^ Conclude the test 
by use of the second blank under the same conditions. For 
com[)arison with the curves of distribution given here, both 
tests must be ap[)lied and in the order just mentioned. 

Treatment of I^ata. — Each word w^ritten in accordance with 
the rules counts one. To determine just wiiat shall be termed 
a ivord,^ the data secured by Anderson, upon which the curves 
that follow are based, was scored by following the division 
made upon each page of the 1910 edition of Webster’s New 
International Dictionary, i. e., any word found above the line 
was admitted; any word found below^ the line (and hence rare, 
obsolete, dialectic, etc.) was excluded. No discount was at- 
tempted for possible instances in wiiich legitimate words were 
hit on by mere accident. As a guide to scoring these tests, the 
lists of admitted w ords are reproduced here. 


aeohmt’tcst 


a 

bam 

ea 

ma 

0 

tab 

ab 

bat 

eat 

Mab 

oat 

tambo 

Abe 

bate 

eta 

Mae 

om 

. tame 

abet 

be 


mao 


tea 

am 

beam 


mat 


team 

ambo 

beat 


mate 


to 

at 

bema 


me 


toe 

ate 

bet 


meat 


Tom 

atom 

beta 


met 


tomb 


bo 


meta 


tome 


boa 


moa 




boat 


Moab ' 




bot 


moat 




bote 


mob 

mot 

mote 
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eairlp-lest 


a 

ea 

1 

la 

I)a 

Ua 

ai 

ear 

Ira 

lair 

pail 

Rae 

nil 

earl 

ire 

lap 

pair 

rail 

air 

el a 


lea 

pal 

rale 

al 

Eli 


leap 

l>ale 

rap 

ale 

epi 


Lear 

pa ler 

rai>e 

alp 

era 


lepra 

pali 

re 

ape 

eria 


lerp 

pal- 

Rea 

April 



liar 

lia re 

real 

ar 



lie 

parel 

reap 

are 



lier 

pea 

rei 

Ariel 



lip 

j)eal 

rep 

arlt 



lira 

pear 

rial 




* 

l)eaii 

rip 





per 

ripe 





peril 

rile 


pi 

pia 

pie 

pier 

pile 

])lea 

plier 


Results. — (1) Xorms are given in Tables 130 and 131 for the 
two forms of the test separately and so distributed as to show 
the average performance for each sex at each age. These norms 
have been compiled by combining the data obtained by Ander- 
son and by Pyle. Percentile distributions for the scores of the 
two tests added together arc shown in Figs. 77 and 78. These 
curves have been derived from Anderson^s data by subjecting 
the raw data to the process of numerical smoothing and by 
further smoothing the curves in the process of drafting them.^ 


TABLE 130 

Averages ty Age and Sex, acohmi-Tcst {After Anderson and Pyle) 


SEX 

AGE 

8 1 

1 ^ 

10 

11 1 

12 1 

13 

14 1 

15 

16 

17 

18 

ADULTS 

Boys>-.( 

Case* 

■18 

86 

103 

112 

124 

134 

109 

85 

t 

59 1 

49 j 

37 

i 

70 

1 

Aver 

5.9 

9.0 

8.7 

10.5 

114 

11.5 

13.2 

15.3 

19.3 

17.0 

16.9 

18.4 

Girls... 

Cases 

48 

101 

128 

115 

141 

99 

118 

96 

1 

94 

70 

53 

93 ' 


Aver. 

7.5 

8.0 

10.8 

11.8 

13.2 

L14.9 

15.0 

15.8 

15.8| 

15.9 

18.4 

20.9 


^See Ch. 3, p. 31, for these methods. 
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On account of the relatively small miinber of cases available 
for each curve, its topography must be regarded as somewhat 
provisional, though the error is j)resuinably within one or two 
points. Tt will be understood that the minimal and maximal 
scores do not afford permanent standards of comparison. 

TABLE lai 


Awratjcs hy Aye and Sc.r\ acirly-Tcsl {After Anderxon and PijU') 



(2) DcpciKleiKV on e//e. Mrs. S(|U ire's conclusion Ibat the 
correlation “between (dlk ieney and malurify is no( so eomplele 
as in many of the other tests" would seem to be based upon the 
examination of too few cases (10 of eacdi age), for the aver- 
ages of Tables IdO and 131, with the single (‘xcepfion of fhaf for 
the O-year-old boys in the ucoh/// Ltest, show a piogressive rise 
with age from 8 to 17 years, while adults are uniformly superior 
fo the boys and girls of 17. The same thing is brought out 
in the combined resulfs set forth in the curves: that for O-year 
boys lies for the most part above that for lOyeai* boys. There 
is also a drop in the upper peirentiles of 15year-old girls that 
is ditlicult of explanation unless there has been some accidental 
selection of poor a8's in this grouj). 

(3) Dependence 0 }i se,t. Comparison of the two tables and 
of the two charts makes it easily evident that girls, at least up 
fo the age of puberfy, are consistenfiy sujjerior to boys and by 
an ainouiit ap})roximately equal to one year's advance. It 
follows that this sex difference must always be had in mind in 
the use of the norms and distributions for this test. 

(4) Dependence on roce, Pyle’s comparative study of whites 
and negroes (3a) shows clearly" the inferiority of the latter in 
this test. In terms of general averages for all ages (in which 
there is^ unfortunately, a certain element of unreliabilify owing 
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to the unequal numbers of the two races tested at different 
ages), the male whites scored 10.8 words in the acohint'iesi 
and 11.3 words in the acMp-ie^t; the male negroes scored 5.2 
and 6.0 words for these tests, respective! Similarly, the 
female whites scored 12 and 13 words against 5.9 and 5.1 for 
the female negroes in these same two tests. These differences 
are, of course, well outside of their probable error. 

(5) Individual differences are decidedly large in this test. 
Inspection of the charts, for example, Avill show that some ^’s 
at 9 are superior to some /^’s at 17 and over. Similarly, in the 
author's first trials of the acohmf-test, 10 of his 36 grammar' 
school >8's scored 15 words or over, while 13 of his college stu- 
dents scored fewer than 15 words. This wide-range distribu- 
tion of the scores is an obvious point in favor of the use of the 
method in diagnosis of individual status. 

(6) Frequency of different icords. By examining the papers 
in detail, and tabulating the total number of words formed and 
the number of times each of these words is given, one may 
discern something of the principles which govern the operation 
of the test. The following are the data secured by the author: 

Test No. 1. 58 College Students. (13 IIiefeken i Words.) 

Over 50 times — bat, mat, bet. 

40-49 times — eat, met, Tom, at, boat. 

30-39 times — meat, to, tea, beat, team, tab, ate, am, moat, mob, 
me, beam, toe. 

20-29 times — tame, oat, be, mate. 

,10-19 times — boa, mote, bate, abet, tomb, tome. 

5- 9 times — Mab, Abe, Mae, ma, atom, a. 

1- 4 times — bot, mot, o, Moab, beta, bema. 

Test No. 1. 50 Grammar-Grade Bovs. (38 Different Words.) 

Over 40 times — mat, bat. 

30*39 times^ — ^bet, at, met. 

20-29 times — to, eat, Tom, beat, tea, meat, be, am, boat. 

10-19 times — toe, mob, beam, me, ate, team, tab, boa, oat 



47: \voRh-nuiLDiN(; 


[047] 281 


5 - U limes — ma, bate, a, moat, mot, tamo, male, InO. 

1 - 4 times — tarn, tomb, Abo, moto, Moab, Mae, o. 

Xoi given — those not given by college students, i)lus abet, atom, 
bema, beta, ^lab, tome. 

Ti:sr No. 2. (>0 College Students. (50 Different Words.) 

•Over GO times — lip, lap. 

.70-50 times — rip, rap, pear, ear, real, pie, leap, rail, pale, reap. 
10-40 times — pail, pile, ale, pair, are, ape, lie, pea, peal. 

:>0 :>0 times — pare, earl, jicarl, air, par, lair, ripe, liar. 

20-20 times — ail, Lear, ra])e, ire, pal. 

10-10 limes — lea, pa, rile, pire, era; pier. 

5- 0 times — per, a, alp, Lli, plea. 

1 - 4 times — I, jialer, peril, lira, rep, rale, ra, April, Tra, la, ]>i, 
lUn). Lae. 

Inspection of these lists shows (a) that three-letter words 
are in e\ (O'v instance those mo.st frequently formed, (h) that 
two-h'tler words and the one-letter words, which one might 
ex]K}ct to l)e most frequent since most simple, sland relatively 
low, c. (/., })!((, he, (nil, pa, me, a, /,- (c) that grammar-school 
iwns give all the words given by college students save a few 
lather nnnsnal terms such as alom and tome, (d) that usage 
and ordinary speaking vocabulary condition the formation of 
words, in as much as the most ordinary words have the greatest 
freqmmcy, c. g., hai, mat, het, cat, llp^ lap, whereas words that 
ai*e less frequently used in every-day speech, although their 
meaning is doubtless perfectly well knoAvn, do not suggest them- 
selves so leadily under the conditions of the test, c. < 7 ., iomh, 
tome, cidy plc.a^ paler ^ (c) that the words not given by any one 
are, wilh one or two exceptions, c. g., plier, words of extremely 
rare usage or unusual form, alternative spellings, etc. 

(7) RcViahilitij. Wyatt found a coetFicient of reliability of 
.88 between the results for two different arrangements of the, 

-It appeared, upon inquiry, that some of the college students had 
omitted words like jm, ina, a, o, and I on the ground that they were ‘riot 
real words,’ or ‘didn't count,’ hut, oflener, they seem to have been^passed 
over IxH'ausr the attention was concentrated upon the making of conn 
hhiuihnfi. 
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letters aedbmt, A sample pcroup of 46 cases from Anderson^s 
data gave a reliabilit}^ of .74, P.E. .07, when the acobmt-te^t 
and the eair?p*test were compared. The word-building test is 
seen, therefore, to possess a good degree of reliability. 

(8) Correlations, Heymans and Brugmans found positive 
correlations of from .12 to .76 between word-building and five 
other tests of imagination (puzzle picture, ,35, solving riddles 
.24, arrangement of syllables .76, jig-saw puzzles .12, Binet's 
paper-cutting test .47). Wyatt’s corrected correlations with 
word-building gave with analogies .93, with the completion test 
.97, with the part- wholes test .09. The raw correlations for his 
two groups of iSf^s were for analogies .54 and .65, for the complex 
tion test .36 and .70, and for the part-whole test .36 and .77. He 
also found raw correlations of .39 and .52 for a test of sentence- 
construction, a correlation of .47 with interpretation of fables, 
but no correlation with the letter-square test. 

The author found no correlations l)etween w^ord-building and 
class standing in the case of grammar-school pupils and' the 
insignificant correlation of .13, P.E., .08, in the case of 58 col- 
lege students. Terman, however, found his stupid boys gener- 
ally inferior to his bright boys. 

(9) Conditioning factors. Age, sex and general intelligence 
are not the only factors that . affect the outcome of this test. 
Thus Terman remarks: ^^Much depends, of course, upon the 
vocabulary at command, and this in turn dei)ends largely upon 
home training and amount of habitual reading as well as upon 
native retentiveness. A second factor is ability to spell, and 
habits of tvord analysis generally. Very important, also, is the 
use of a rational plan ; some skipped about and made combina- 
tions at random, while others took the letters one by one and 
joined, them in as many different ways as possible with the 
others. Lastly, the rate of shifting of attention, and the degree 
of mental inertia as opposed to spontaneity, also contribute to 
the result” (5,p.342). 

REFERENCES 

(I> E.. J. Anderson, Standardization of some mental tests. (Study 
from the Cornell University Educational Laboratory, as yet unpuh- 
Jisbed.) 
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(5) L. M. Teriiian, Genius and stupidity : a study of some of the intel- 
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TEST 48 

Ebbinghaus* completion method. — In July, 1905, the school 
authorities of Breslau requested certain persons, among them 
Professor H. Ebbinghaus, to undertake a scientific investiga 
tion of the fatigue-effects of the continuous five hour session 
then in vogue in that city. In the course of this investigation 
Ebbinghaus devised and applied, in conjunction with other 
tests, what he termed the ‘Comhinationsmethodc^ (since re- 
ferred to by Elsenhans as the Vompletion-method^ and by otheiss 
as the mutilated text or missing- words test),^ 

The author of the method says in substance: Mental ability 
demands not merely retentive capacity, readiness of recall, or 
facile association of specific past experiences; it demands all 
this and something more, something more complex and, as it 
were, creative; namely, the ability to combine, into a coherent 
and significant whole, mutually independent and even seem- 
ingly contradictory impressions. In short, intelligence is essen- 
tially a combinative activity. To measure intelligence, there 

*Meyer has pointed out the inaccuracy of the translation “combination- 
method,” which has been current for some time. The German Oom- 
hinatiovsgahe is not a talent for combination, bnt an ability to “put two 
niid two together,-’ or, to use Meyer's explanation, “a talent for drawing 
conclusions from premises which do uot very readily present themselves 
to a maiVs consciousness as items of a unitary logical thought, but which, 
as soMi as they arc eomhined, suggest the conclusion very forcibly.” This 
is quite true, but the author can not see that Meyer has improved mat- 
ters by advocating the translation “conjectural method.” To conjecture 
is to surmise, to guess, to form a tentative opinion, -inferentially. Tech- 
nically, the activity in the Ebbinghaus test might be labelled ‘redintegra- 
tion,’ but, as this term is somewhat clumsy, the designation ‘completion 
method’ seems entirely adequate. 
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fore, we must emplo}^ a test that demands ability to combine 
fragments or isolated sections into a meaningful whole. Such 
a test may be atiorded by mutilated prose, i, e.^ by eliding let* 
tei's, syllables, words, or even phrases, from a i)rose passage 
and requiring the examinee to restore the passage, if not to its 
exact original form, at least to a satisfactory equivalent of it. 

On account of the enthusiastic statements of Ebbinghaus, 
who characterizes this method as ^^a real test of intelligence,’^ 
and as ^^a simple, easily a})plied device for testing those in- 
tellectual activities that arc fundamentally important and sig- 
nificant both in the school and in life,” the test has assumed 
some prominence. 

The classification of this method in a system of tests is not 
always easy, for the simple reason that what mental processes 
it demands depends almost entirely upon the number and 
kind of elisions that are made in the text. To take extreme 
cases, if the elisions are numerous and sweejiing, it may be- 
come really a linguistic puzzle of a very dilficult variety, and it 
then belongs rather in the group of tests of active or creative 
imagination of the literary type; if, on the other hand, the 
elisions are but few and simple, it may degenerate into a sim- 
])le test of controlled association of any desired degree of ease. 
Again, if the original text be first read to the examinee, as 
some, c. g.^ Elsenhans, suggest, the test becomes in the main a 
test of associative recall, i. c., a form of memory test. 

Since the elision of a single letter may, in some circum- 
stances, very considerably increase the difficulty of the test, it 
follows that, without extensive preliminary trials, it is well- 
I'igh imiiossible to prepare a series of texts of equivalent diffi- 
culty, or to insure that the several sections within a given text 
])reseut equivalent difficulty. 

That these difficulties in the preparation of the text are real 
and serious is attested by the unanimity with which they are 
expressed by all investigators. They have led some experi- 
menters to question whether the method did, after all, get at the 
mental activity it was designed to call forth, but the trend of 
opinion has been on the whole distinctly and even enthusi- 
astically in favor of the test. 
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The following is a sample section of text as used by Ebblnghaiis and 
other German investigators: the dotted lines indicate the position and 
approximate length of the omissions. 

Bel a gening Kolborgs. 1807; 

“Da del* Feind fortf an....neucn Sclinnze am Sandwege. . . . 

angestr. . . .. . .Eifer 7A\ so haite miser neuer Kommandani 

gleich ersteii Nacht llierseins eiium Ans dioselbe 

angeordnet,” etc. 

Tcrman elided, in the main, whole words, instead of syllables, on the 
ground that the word is a more natural unit of language tliaii tlie 
syllable, and that ability to supply missing syllables will, in the case of 
school children, depend largely on the extent to whieh word-analysis has 
been taught in the schools: this varies in diffciaait school systems and 
even in different classes of the same system. 

Materials. — Stop-watch, or for group work, the special sec- 
onds clock is recommended. Four printed texts. [If all four 
texts are to be used for the test, E should j)repare a short sam- 
ple piece of mutilated text, say three or four lines, which may 
be typewritten, or placed on the blackboard fur gi'(»n[> work, 
and used for demonstration and preliminary trial. If one of 
the texts is not used, this may serve the purpose.] 

Text No. 1, prepared by the author, has been used by him in 
tests upon college students and by Mrs. Squire in lesis u[) 0 h 
school children. It contains 100 elisions, including some in 
which, in accordance with Ebbinghans’ plan, portions of words 
as well as entire words are elided. 

Text No. 2, taken from Terman (IS), has been used by Wyatt 
in tests upon English school children; it contains Oo elisions. 

Text No. 3 is designed especially for use after a pi'cliniinary 
reading of the entire completed form. It is taken from Ter 
man and contains 100 elisions. 

Text No. 4, taken from Terman and Childs (10), Snd not 
here reproduced, is substantially the same }>assage as No. 2, 
but the elisions are iiiade ufjon a new plan, such that there are 
four sections representing four dilferent degrees of elision. In 
the first section 33, in the second 45, in the third 54 and in the 
fourth GG per cent, of the original material is elided. This text 
demands a special system of scoring. In use in the author’s 
laboratory it has been found that the second and third blanks 
are peculiarly unfortunate: they are too difficult and tend to 
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produce discouragement and confusion at the outset. Many 
adults also find the fourth section easier than the third, despite 
the gi'eater amount of elision in it. However, the text has been 
retained as presented by its authors on account of the norms 
published for it by them. 

The reader who desires to try yet other texts will find eight 
of them in Simpson (16, pp. 119-121). 


In the reproductions here given, italics indicate the elisions in the 
printed text. 


Text No. 1. 


Where the Dandelions Went. 


When Willy was two years old, he lived in a red farm-hot/se le^ith a 
yard in front of it. The dandehoas were very thick there; so that the 
yard looked yellow instead of green. 

One bright day Willy's mamma put on his straw hat and sent him out 
into the yard to play. She knew the yard had a high fence; and he 
could not open the gate; so he was safe. When it was time for him to 
have a nap and she went to call him, she notic*ed that a great many of 
the dandelions were gone. She wondered where they icere; but, as Willy 
could not talk much, she did not ask him about them. 

A short time after, while he was asleep in his crib, his mamma went 
out to draw some wixter. When the bucket came up full of tvater, the 
top was all yellow with' dandelions. Ijooking down into the tvell, she 
could see no water at all, only dandelions. 

It teas no wonder, then, where the blossoms had gone, Willy had been 
very bu:y, trying to fill up the well. 


Text No. 2. 

The Strength of the Eagle. 

One day the eagle ivent with the other birds to see tchich could fly the 
highest. They agreed that he who could fly the highest should he called 
the strongest bird. All started at the same time and flew away among 
the clouds. One by one they grew weary and returnedy but the eagle flew 
upward and upward until he was a mere speck in the heavens. When he 
came back, the others were icaiting for him ; and when he touched the 
ground a linnet flew off his back where he had been hidden and said 
4hat he himself was the strongest bird. “/ am stronger than the eagle 
said ti^ linnet, “for not only did I, fly as high, but when he- began his 
downward flighty I left my hiding place and flew up a little higher.** At 
this boastful speech the others shook their heads and called a council to 
decide the matter. After a long debate they decided that the eagle was 
the strongest bird, for not only did he fly so high, but he carried the 
linnet as well. 

-To this day the plumes of the eagle emblems of strength and 
courage. 

Text No. S. 

Why the Mole is Blind. 

. An Indian once chased a squirrel into cloud/and. Then he set a trap 
for him, laughing to think how he would catch him. The squirrel did 
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not conic back, but alas! tbe sun ou his ilally rounds fell right into the 
trap. 

When ilic bright stinlighi did not coiiio, the Indian began to be uneasy, 
and when he found his trap had the sun fast he did not know what to do. 

Ho tried to (jet near enough to loosen the cords, but the heat from the 
sun scorched him and he gave it up. 

Then he coa.vcd many animats to try it, imt they all found the sun too 
hot. At lust the mole said: “I will dig through the ground under the 
trap and so get at the cords.'* 

This he did and the sun leaped up into the hca' ms. 

But it went so quickly that the poor mole could not get away, and tbe 
heat of the sun put out his eyes. 

I^incc then llie moles have had to live in dark places, and unless one 
looks very closely he can not find their eyes. 


Method. — Provide S with a demonstration or practise text 
(either one of the three regular texts not to be used subse- 
quently — exce})t that Text 2 should not be used if 4 is to 
follow — or the special sample i)repared by E). Explain the 
nature of the test, in accordance with the directions i)rinted on 
the test-blanks. It is well, in addition, to suggest that, in case 
a certain elision oilers special diflicnlty, it may be temporarily 
passed by, since the correct interpretation of the context fur- 
ther on will often give the necessary cue for the omitted elision. 

When it is clear that understands the conditions, proceed 
with the test propei\ If but one trial is to be made, use Text 2 
or 4 with a 10-inin. limit. If more than one^^ follow Avith Text 
1, using the Avork-liinit method. 

Record the time and make notes of the manner in which S 
undertakes the test. Does he read it all over first? Does he 
work systematically? Attentively? With confidence or hesita- 
tion? Does he grasp the general thread of the story? 

VAniATioNS OF Method. — (1) To conduct the test with the 
memory feature, employ Text No. 3, whieh is specially ifcvised 
for that purpose. After the preliminary trial, read the uninu- 
tilated text for No. 3, >eiitire, to S. Then supply him with the 
No. 3 test-blank and proceed as before. The text may be read 
more than once, or any desired time-interval may be introduced 
between the reading and the execution of the completion. Other 
variations Avill suggest themselves, e, auditory, visual, or 
auditory-visual reading, etc. 
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(2) To approximate the conditions observed by Brown, Wyatt 
and others, give ^ opportunity (say three to five minutes) to 
examine the text before filling it out. This variation of method 
obviously changes the character of the test considerably: it 
tends to greater uniformity in the mental processes of the 
but it removes the differentiation which the standard method 
conserves in that some /8’s are quick to see the necessity of 
looking over the text ahead of their work while others are not. 

(3) The Ebbinghaus test lends itself rather well to grou]) 
tests. With Texts 1, 2 and 3 the use of the author's seconds- 
clock- is recommended. If, however, the time-limit method is 
followed, the limit must be so chosen that the fastest in the 
groups under comparison can but just complete the >vork. 
For adults, 7 min. may be employed for Texts 1 and 2, a shorter 
time for Text 3. Text 4, it should be noted, is devised to be 
scored by the time-limit method only. For it Terman and 
Childs specify 15 min. Unfortunately, tJiis time is too long for 
some high-school students, as investigations in the author's 
laboratory have shown; in fact, even when the time is shortened 
to 10 min., a few pupils (about 2 per cent.) will finish before 
that time is up. 

Tueat.ment of Data.— Text 4, as already mentioned, is used 
with a constant time-limit (15 min., according to its origina- 
tors, but preferably 10 min., according to the author's expe- 
rience). It is scored by assigning for each correctly filled 
blank 0 units in Section I, 8 units in Section II, 10 units in 
Section III and 13 units in Section IV. The total score is then 
divided by 10 and amounts to 100 (exactly, 100.2). One-half 
the above credits are given if the inserted words “make a well- 
connftted story," but are “related in only a moderate degree 
to the thought that should have been given." No credit is given 
for inserted words that make no sense in their setting nor for 
words that make a continued story which is “purely literary 
invention, having no connection with the thought given by the 
printed words." Thought is “considered rather than elegance 
in diction." ^ 

=8ee Vol. 1, p. 9. 

’For samples, see Terman and Childs, pp. 201-202. 
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For Texts 1, 2 aud 3 there are three possible methods of scor- 
ing. For adults, workifig individually with these texts, the 
quality of the work is usually so good that speed alone may be 
used as an index of efliciency. 

Secondly, speed may be neglected and attention given only 
to quality (in which case the instructions should be modified 
to indicate that S may ‘take his time’), in example of this 
method may be seen in the work of Burt, who graded the worth 
of each inserted word on a system of 6 points, 0 to 5. 

Thirdly, speed may be combined with quality, and in one of 
two ways. The quality may be determined and related to speed 
by means of formulas like those developed for the cancellation 
test (No. 2G). Or, again, the time-limit method may be fol- 
lowed and the work scored by the plan proposed by Ebbinghaus 
himself and used by Krueger and Spearman, Brown, Wyatt 
and others. Here quantity and quality of work are computed 
as follows: (1) Give a credit of EO for each elision filled in in 
any manner. (2) Give a debit of 0.5 for each elision unfilled 
in any manner. (3) Give a debit of 1.0 for each elision filled in 
such a manner as not to iiiake sense, or for each word intro- 
duced in excess of the number called for by the lines that indi- 
cate elisions (or, if desired, also for each word that is quite 
obviously too short or to long for the space assigned for comple- 
tion, even though the passage hnakes sense’).^ For quantity of 
work done, add (2) and (3) and subtract the sum from (1). 
For quality of work done, compute the relation in per cent, of 
the same sum to (1). 

Typical Results.— The foltowing is a sample of the work of 
a boy, 11 years old, one of Termau’s “bright” group, avIio ^com- 
pleted’ Text 2, with the exception of three elisions, in 2(linin- 
utes. He was quick, steady, and looked ahead. 

“One day an eajjlo went with the otliei* birds to see who could fly the 
highest . . . (Next three sentences correct) . . . When he came 

back the others were waiting for liiin ; and when he touched the ground 
a linnet flew otf his back where the thief hau hidden and said that he 
himself was the strongest bird. “I am stronger than ybu are, ’ said the 
linnet, “for not alone did I fly as high, but as he began flying downward, 
then I left my biding place and flew up a little higher,” etc. 


^Cohn and Dieffenbacher penalized only 0.5 for errors in the length of 
the inserted word. 
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Tlie following is a sample of the work of a boy of the same 
age, one of Terman’s. ^^stupid” group, who worked for 25 min- 
utes at the same text. Save in one or two easy sections, his 
‘completions’ make no sense at all. He worked by phrases only. 

**One with the eagle and with the small birds and see who could fly 
the highest, and agreed and he who will fly the highest should be called 
the strongest they All started in the same place and whent away among 
the clouds. . . . After a while he decided that the king of the little 

bird and not only and not he was so high, but he did the thing ns well," etc. 

Results. — (1) Norms and dependence on age. The results 
gained by Terman and Childs with Text 4 are shown in Table 
132, in which the last column is presented as a basis for the use 
of the test diagnostically; i. e.^ the score reached by 6G per cent, 
of the children of a given age is taken as the limiting standard 
of efficiency for that age. Tables 133 and 134 show the results 


TABLE 132 

Completion Text No. .J. 15’Minute Limit {Terman and Childs) 


AGE 

CASES 

MEDIAN . 

P. E. 

REACHED BY 66% 

9— 

32 

18.4 

8.5 . 

14.0 

10 

39 

29.2 

11.8 

20.4 

11 

52 

32.2 

11.1 

25.2 

12 

5G 

34.2 

11.7 

25.6 

13 1 

57 

45.9 

15.2 

36.6 

14 —J 

33 

48.5 j 

9.4 

42.8 


for boys and for girls, respectively, obtained by Hr. Fraser, of 
the Cornell Laboratory, with Text 4, but with a 10-ininute time- 
limit. In these two tables the number of cases for every group 
is givtn in parenthesis just above the group average, and the 
groups are sorted to differentiate age and school grade as well 
as sex. 

It will be seen that at 13 and 14 (when the sexes are com- 
bined), the Ithaca children have the better scores despite the 
fact that they worked but 10 min. This difference is partly due 
to the inclusion of high-school pupils in {licse ages, whereas the 
table of Terman and Childs is limited to children from the 
4th to the 8th grades at Palo Alto, California. 
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Cohn and Dieffenbaclier's tests show progress with age, even 
np tp'the 20th year. 

(2) Dependence on school training, Wiersina called atten- 
tion to the fact that the relation between perforipaiice in this 
test and age is far less evident than thaJ between perforniance 
and scholastic status. This fact is illustrated clearly in the 
fables prepared by Fraser: taking, for instance, the results 
for girls, averages by ages, 13-19, run 70.9, 63.2, 57.3, 61.8, 65.8, 
63.2, 70.4, and show no definite correspoadence, whereas the 
averages by school grades, 8th to fourth year in the high sc hool, 
run 38.9, 56.5, 67.7, 64.5, 80.7. . Since there exists a distinct 
j)Ositive correlation between standing in this test and general 
intelligence, and since the higher the grade of pupils of a given 
age, the more intelligent, on the whole, they must be, it follows 

TABLE 133 

Completion Text No. 10-Miniitc lAmit. Results for Boys (Fraser) 



! 8 

H. S. I 

H. S. II 

H. S. Ill 

H. S. IV 

All 

IB 

(7) 

(6) 

(2) 



(15) 


46.3 

54.1 

1 32.6 

! 



i 46.9 

14- 

(9) 

(18) 

(9) , 

(1) 


(37) 

36.5 

54.1 

46.3 

54.6 


48.2 

15 

(7) 

(22) 

(7) 

(3) 

(1) 

(40) 

39.5 

48.5 

61.9 

44.1 

92.6 

50.0 

16 

(2) 

(5) 

(7) 

(11) 

(3) i 

(28) 

42.1 

38.7 

55.9 

73.3 

73.9 

.60.6 

17 

(1) 

(3) 1 

(11) 

(13) 

(8) 

(36) 

34.0 

42.5 

61.5 

58.0. 

62.5 

58.1 

i« 


(1) 

(4) 

(8) 

(7) 

(20) 



33.2 

51.1 

43.7 

56.5 

49.1 

19 



(1) 


(8) 

(9) 



32.0 


61.9 

58.6 


(26) 

(55) 

(41) 

(36) 

(27) 

(185) 


40.3 i 

49.4 

54.1 

58.2 

63.2 

52.9 
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TABLE 134 

Con]i>J( t ion Text yo. 10-Minutc Limit. Results for Girls (Fraser) 


GRADES 



8 

. H. S. I 1 

H. S. II 

H. S. Ill 

H. S. IV 

All 

13 

(4) 

(4) 1 




(8) 


66.3 

75.3 ' 

! 




70.9 

11 

(5) 

(26) i 

(7) 

(1) 


(39) 


37.3 

62:4 1 

83.2 

71.0 


63.2 

15 — 

(8) 

(28) 1 

(11) 

(6) 


(53) 


46.9 

50.4 i 

74.1 

72.7 


57.3 

K - 

(2) 

(fl) i 

(19) 

(13) 

(2) 

(42) 


34.4 

45.0 ! 

66.9 

61.8 

89.9 

61.8 

^ 


' (1) : 

(10) 

(17) i 

(5) i 

(33) 



1 49.0 1 

1 i 

57.3 

65.7 

86.6 

65.8 

18 

i 

I (3) i 

(2) 

(12) 

(8) 

(25) 


[ ! 

! 54.3 ! 

- ! 

30.0 j 

63.9 

75.1 1 

63.2 

19 

j 

(1) ■ 

(1) i 

(2) 

1 (2) ' 

(6) 



79.5 i 

82.0 

4G.4 

S4.2 

70.4 

All 

(19) 

' (69) 1 

(50) 

(51) 

(17) 

(206) 


38.9 

‘ 56.5 

67.7 

1 64.5 i 

[ 1 

. 80.7 

61.1 


that some part of this eorrespondence between school status 
and the results is due to the correlation with iivtelligence. The 
effect of the school training itself undoubtedly contributes an- 
other portion of the correspondence — just how much cannot 
be said. 

(3) Dependence on sct. Although Wiersma could not make 
out sex ditfereiices with certainty, the subsequent work of 
Burt Jiiid of Fraser leaves Hi tie doubt that girls are superior 
to boys in this, as in most tests with verbal material. Burt 
found girls distinctly better than boys in his text Tlie Tivo 
2 ]fafche$ (means 84 and 70, respectively) and slightly better in 
another test of a more argumentative character (53.2 to 50.4). 
Inspection of Fraser’s tables will show that, with the excep- 
tion of the Sth-year averages, the girls excel in every group. 
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whether comparison is made by ages or by school grades. The 
superiority of boys found by Burt and Moore in one test is 
attributed by them to the nature of the text, which was such as 
to appeal more strongly to the interests and knowledge of the 
boys. It is diflicult to reconcile, however, the results reported 
by Cohn and Dieffenbacher, who found girls inferior to boys at 
all grades and regardless of equivalence in ages. These sex- 
differences were greater in the upper than in the lower classes 
and sufficient to bring the better girls on a level with the 
poorer boys of their age and grade. It is possible that this 
striking oj)])Osition to the results found by , others may be due 
to some differences in the organi-zation of the schools at Frei- 
burg. 

It is unfortunate that Terman and Childs have made no 
distinction between the sexes in reporting their averages and 
establishing their age standards. 

(4) Inilividu'al differences, Bistribution of the data obtained 
from the completion method reveals large individual differences. 
This is demonstrated by the large size of the P.E. in the data 
of Terman and Childs and even more definitely by the percentile 
curves of distribution for each sex prepared from Fraser's 
combined results for i)iipils from 14 toll years of age (Fig. 79). 

(5) PraellsCy accoi'ding to Wiersma, may effect an improve- 
ment in cfficiemw in the completion test that may be easily 
discerned after the lapse of 10 days, and even after an int(Tval 
of 6 weeks. As a consequence, it is evident that, in making use 
of this ti*st for comparative Avork at different jferiods, steps 
must be taken to eliminate or com])ule the ]a’actise-effect. 

(6) Dependence on fatif/ne. In Ebbinghaus' Breslau investi- 
gation no fatigue effects could be made out as the result of the 
five-hour session in the tests Avith the up})er classes, or at least, 
if fatigue aatug ])resent. it Avas masked by pracli.se. In the loAver 
classes (10-12 years) there ap])eaied to be a decrease in the 
quantity and quality of Avork toAAard the end of the session. 

These conclusions have been criticized by several exj)eri- 
menters. Binet and ITenri contend tliqt the several texts Avere 
of too unequal difficulty and that the method of scoring aaus 
ai*bitrarA’’ and crude, . liObsien has also criti<*iz<.‘d the general 
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<FIG. 79 . PERCENTILES FOB COMPLETION TEST NO. 4 . AGES 14 TO 17 COMBINED 

(Fraser). 
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plan of administration of the tests in the Breslau investigation. 
It is admitted that the material used was too easy for the upper 
classes, and that this circumstance tended to obscure the in- 
fluence of fatigue and other factors. 

In the opinion of Ivraepelin, the Ebbinghaus test is to be regarded 
more as a device for exploration than as a decisive and accurate device 
for measuring fatigue, for, in tlie first place, no \vsteinntic study has yet 
been made of the relations between mental fatigue and the coui[)iex 
activities concerned in tliis test, and* secondly, the evaluation of the 
errors is so diificiilt and their scoring so arbitr u-y that the test is not 
Avell designed for single applications iStichi>rohc) and statistical 
treatment. 

Wiersma compared performance before and after a 10-days vacation, 
but he expresses his belief that the marked improvement cited above as 
exhibited by the pupils at the second test was largely due to ]>ractice. 
It is unfortunate tliat proi^er measures Iiave been not taken lo eliminate 
the practice error in these, and in otlier ai)i)licatioiis of the completion 
test. 

(7) Dependence on intelligence. It has already been inti- 
mated that the relation demonstrated l)et\veen ])erroi*inance in 
the completion test and scholastic standing is partiiiMy condi- 
tioned by a direct correlation with intelligence. Such a rela- 
tionship was found by Ebbingliaus, most clearly in the lower 
and progressively less clearly in the higher grades, by section- 
ing the Breslau pupils into three grou])s — best, average, poor- 
est — on the basis of their class standing: these three sections 
scored 5G, 48 and 43, respectively, in quantity of work, and 
17.3, 20.8 and 26.3, respectively in quality of Avork (percentage 
of errors). Similar results Averc readied by Cohn and Dieffen- 
bacher. Wiersma found a ])ositiA'e correlation belAveen capacity 
in this test and nati\"e ability (Dcgahinuj) , both in tests at a 
teachers’ seminary (ages 14.5 to 19.5) and at a continuation 
school (ages 12 to 15). 

Since then, statistical treatment by the more accurate corre* 
lation methods has continued to reveal positive correlations of 
good magnitude between the completion test and intelligence. 
Brown, for example, found a correlation of .43 with one group 
(66 boys, aged 11-12 years) and of .09 with another group (39 
girls, aged 11-12 years), and he declares that the Ebbinghans 
test ^‘is a good measure of intellectual ability. It correlates 
with ^general intelligence’ almost as closely as 'scholastic in- 
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telligence^ (school marks) does.” Burt reports correlations 
of .48 and .53, Wyatt of .85, P.E. .04, with one group and of 
.61, P.E. .07, with another group. Simpson, who compared the 
capacities of two contrasting groups of adults in numerous 
tests, found that the. Ebbinghaus method almost completely 
separated his two groups, and that there was a correlation of 
.89 between results with his ^good’ group and the estimated 
intelligence of the members of that group alone. 

Wyatt applied the analogies and the ooinpletion tests to seven children 
who were candidates for admission to the Fielden School, Manchester, 
England, and was able not only to ad\'ise whith of the candidates should 
be admitted and which not, but also to predict successfully the approxi- 
mate position that these pupils would take in their class at the end of 
the term. 

Ebbinghaus believed that the correlation between the completion test 
and school ability might become obscured (1) because the test puts 
a premium upon speed of work, whereas the school grade is based on 
work that permits of a slower pace; (2) because, in some part, standing 
in the test might depend upon purely formal linguistic skill or verbal 
dexterity — a form of ability which bo thought had but a limited scope iu 
school work; and (3) because the text selected for the test might bo 
too easy. 

Iu the author’s opinion, these reservations are scarcely in order, iiFso 
far as Ebbinghaus implies that sc'bool grades are inferior to his test as a 
measure of intellectual ability and asserts that linguistic readiness plays 
no part in the determination of school grades. 

The autlior is inclined, rather, to agree with Terman when he says: 
“My experience with the test causes mo to regard it favorably; but, like 
all others, if taken alone, it can give only a partial account of the 
subjects’ ability. It certainly does indicate something as to the general 
coninnnnd of language. I am inclined to think tiiat somewhat me- 
chanical activities like memory and association, as distinguished from 
synthetic or combinative processes, play a relatively more important 
role in this test than Ebbinghaus assigns to them. Indeed, verbal 
memory, in the broad sense, would seem to be the chief factor in 
success.” Incidentally, ability to spell, degree of familiarity with the 
type of literature from which the selection is taken, and the way in 
which 8 happens to go about the test niay all affect his rank. Indeed, it 
is possible that a very original 8 , one Avitli a spark of literary invention, 
might fare relatively poorly. 

Termau and Childs say: “We believe that it [the completion test] 
♦bHngs to light fundamental differences in the thought processes.” 

(8) Delinquents. Text 4 has been used by the author, to- 
gether with numerous other tests, in examinations of the men- 
tal status of certain selected ‘citizens’ of the George Junior 
Republic, carried on with the assistance of Mr. Fraser, at 
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Freeville, N. Y. While our data (Table 135) are too few to 
generalize from, they reveal, as far as they go, distinct reduc- 
tions from the normal performances for >S''s of I he ages con- 
cerned, and these reductions, it is of interest to note, bring 
the averages in fair agreement with the standards corresjjoml- 
ing to the mental ages at which these aS's had been rated by 
the other tests. These results, then, ten'' to contirin the con- 
viction that the completion method is of considerable value 
in diagnosis of mental status. 


TABLE 135 


Coinplctirn Tc.it Jj. 15-Minnic Limit, R(\'^Hits from ‘Citizen^' of iltc 
George Junior Republic (Whipple and Fraser) 


SEX 

CASES 

CHRON. AGE MENTAL AGE 

AV ERAGE 

M. V. 

Boys 


1 

14-19 1 

10.0-12.5 

27.G 

13.0 

Girls 

! ' 1 

15-18 1 

1 

9.0-11.2 

35.7 

15.4 

i 

(9) ReliahUitij, 

Coefficients of 

rel iabi 1 i ty comjuil ed 

by di 


fereiit investigators for varying forms of this test have as a rule 
been quite high; thus. Brown finds the coefticient mostly over 
.70, Simpson .92 to .96, Burt .68, Burt and Moore, ..58, and 
Wyatt .89. 

(10) Correlations with other tests, Ileymans and Brugmans 
report the following correlations with the Ebbinghaiis test : 
discrimination of abstract terms .54, memory for ideas .56, 
problem solving .56, detection of grammatical errors .72. Wyatt 
found correlations as follows: with analogies .85, with word- 
building .70, with part-wholes .75, with interpretation of fables 
.69, with (/y/ 03 -test. 43, ivitli memory for nonsense syllables .61, 
with dissected pictures .41, with letter squares zero. For nu- 
merous correlations discovered by Brown with six different 
groups of S% consult the original texts ‘(2b, pp. 122-123, or 2a, 
p. 316, or the same material may be gathered from Simpson, 
pp. 107-8). Simpson found correlations of .85 with hard 
opposites. .72 with easy opposites, ,82 with memory for words, 
.71 with memory for ideas, .6.5. with adding, and .54 with the 
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test. Corrected correlations reported by Krueger and Spear- 
man are as follows: completion test and pitch discrimination 
0.81, completion test and adding 0.93, completion test and the 
liYj)otlietical ^central-factor’ 0.97. The completion test was 
not found to correlate with a lest of memory span {Ausicen- 
(Itfflciitcn) , The extremely high correlation with the ^central- 
factor' is of special interest, since, if the argument be admitted, 
it demonstrates a veiw close dei>enden(‘e of performance in this 
test ui)on a certain hyjmthetical psychophysical capacity, pre- 
sumably akin to ])lasticity of the central nervous system, which, 
in the o})inio]i of these authors, is, for each individual, a funda- 
mental conditioning factor in the performance of various forms 
of mental activity. 

Notes. — At the risk of repetition, it may be pointed out again 
that the outcome of the completion test hinges largely upon the 
degree of difficulty of the text employed: too difficult or too 
easy texts are alike undesirable, for the former convert the test 
into a blind juizzle, while the latter fail to bring out char- 
acterisUc individual differences of ability. 

To use the test on an extensive scale, therefore, we need to 
have at hand a number of texts that have been standardized by 
comjurheusive trials with groups of S’.s of both sexes, various 
ages, and various degrees of cajiacity and training. In other 
words, we need a series of norms of |)erformance, or ‘coefficients 
of difficulty/ as it Mere, for an adequate nuinber of prescribed 
1(‘x(s. Tables 133 and 134 represent a contribution in this divec- 
lion from the Cornell Laboratory. Any investigator can im- 
prove them by adding to them his own data. 

Tlie difficulty of making comparisons between the results of 
dilFeient texts applied at different times may be further reduced 
by always permitting each #8 to finish each text,* and by dis* 
trihufing the texts to be compared in such a manner as to 
eliminate by subsequent computation whatever error arises 
from tlibs difference of material. 

The Lipmann-Werthehner modification of the completion 
method is essentially as follows: a test-story is read to S to 
supjdy him with certain information wliicli he is supjiosed 
iherenfler lo conceal. lie is subsequently given for completion 
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a mutilated text, the elisions of which are so arranged as to 
trap him into introducing farts from the test-story which he is 
tn ing to conceal. 

In an endeavor to retain the essential psychological features 
of the Ebbinghaus test and at the same time avoid the disturb- 
ance due to dependence upon linguistic aptitude, Ilealy lias 
devised a 'pictorial completion test. This i carried on vrith the 
aid of a brightly colored picture, 10X14 inches, which represents 
an outdoor scene with ten discrete, simple activities going on. 
Ten one-inch squares are so cut out from this picture as to 
remove 10 different objects, each of which is essential to 
complete one of the activities. S' is given the incomplete pic- 
ture, the 10 cut-out x>ortions, and 35 other one-inch squares of 
which 30 bear other objects while 5 are blank. His task is to 
insert the 10 squares that he judges essential to complete the 
picture. Data thus far published indicate that the test is diffi 
cult below the age of 9, that performance may be as good at 
10 as at 13, and that some adults make poorer scores than chil- 
dren (due to their more critical attitude toward the drawing). 
A time longer than 5 min. with more than one ‘illogical’ or more 
than two ^totaF errors is suspicious of defective mental abiliiy 
in >8’s above the age of 10. This test would apiiear to possess 
many possibilities of develoimient. 
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TEST 49 

Interpretation of fables, — In 1003 Swift suggested that men- 
tal ability might be measured by determining the capacity to 
interpret the typical situation given in a typical fable. The 
three test-fables employed by Swift ivere later (1006) -used by 
Terman in his comparative study of bright and stupid boj’s. 
Still later (1912) Terman and Childs published a set of eight 
fables selected by trial from a series of 20, with the idea that 
responses to this test would assist in mental diagnosis in con- 
junction with the Binet-Simon and other tests. These authors 
believe that this ^generalization test,’ as they term it, ^Svill 
prove a usable addition to the scale. It presents for interpre- 
tation situations which are closely paralleled in human social 
relations. It tests the power to unravel the motives underlying 
acts and attitudes, to look behind the deed for the idea that 
prompted it. It gives a clue to the status of social conscious- 
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ness. This, if correct, is tremendously important for the diag- 
nosis of the upper range of mental defectiveness.’^ . . . ‘‘It 
does not need to be unduly complicated by language difficulties, 
as is always the case to greater or less degree in tests of ability 
to interpret poetry.” ^ 

^Iaterials. — Printed sheets, containing the 8. fables selected 
by Terman and Childs. 

Method. — Instruct S substantially as follows: am going 

to read to you some fables. A fable is a little story that is 
meant to teach a les'son (convey a moral). After I have i*ead 
each fable, I want you to tell what is the lesson lhat you think 
it teaches (the moral that it is intended to convey).” Read 
each fable twice through before asking for its point. For ordi- 
nary testing use Fables I, III, VII and VIIT. These four have 
been specially selected by Terman and Childs from the eight 
supplied, as proving in actual test to answer best the expected 
requirements of due progress in scores with advance in age.^ 

It is best to conduct the test individually and to record ver- 
batim the replies given orally by S; it is i)ossibIe then to follow 
up /8’s response by a few discrete questions if necessary to be 
positive of his interpretation. If group tests are made, supply 
each S with a blank sheet containing eight numbered spaces in 
which the replies may be written. The norms of Terman and 
Childs that follow are based upon such group. tests with writ- 
ten replies for Fables I, III, VII and VIII. 

Variations of Method.— I f time permits, supplementary or 
control tests may be made by the use of ^he four remaining 
fables. 

TrEx\tment of Data. — We quote as follows from Terman and 
Childs: “The difficulty of finding a method of scoring which 
does not give too large plaj' to the personal equation is a serious 
criticism of the fables test. After experimenting with a 
number of methods the following system was adopted as the one 
best suited to bring out objective differences and to call atten- 


’See. for example, the test nsefl by Uonser. p. 8. 

*See Terman and Chfids, p. 138, for the criteria upon 
fables were finally chosen.^ 


uiiich these four 
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tioii to certam^tyi^s of auswers significant for clinical pm*' 
poses.: 

^‘(«) A completely generalized and entiiely relevant reply. 

5 units. 

^^{h) A generalization, quite plausible, but slightly ditfering 
from the correct one, or else a correct statement mostly gen- 
eralized but not perfectly free from the concrete, 4 units. 

^(c) Correct idea stated in purely concrete terms, 3 uni Is. 

“(d) An irrelevant generalization, 2 units. 

“(c) A re])ly in conerete terms with just a trace of relevancy, 

1 unit. 

“(/“) No response, or an entirely irrelevant concrete state- 
ment, 0.^^ 

“Elegance, grammatical coiTectaess, spelling, etc., sliouKl have no 
weight in the scoring. On the other hand, it is necessary to be discrlm- 
inaiing as to essential thought in the response. The tendency of the inex- 
perienced scorer is to give »oo innch credit. “In practise there is t\ tend- 
(Micy to make sparing nse of S<'ores 1 and 4, reserving 1 for a few replies 
that arc not qnite had enough for 0, and 4 for a few replies, \y!iich, 
though pertinent and generalized, arc not quite what is wanted.” 

The following .samples of scoring for replies to the four standard fables 
will serve as useful illustrations: 

Fable L The Haiti and the Eggs. 

Score 0. “She wanted to be dressed nice and be praised.’*' 

Score 2. “Not to carry things on the head.” “Not to be selfish.” “Not 
to boast.” 

Score 3. “If the maid had not planned so far ahead she would not 
have dropped her milk.” “Don’t make schemes for the future while you 
are carrying milk.” 

Score 5. “Don’t count your chickens before they are hatched,’* “Not 
to build air-castles.” “Doji’t plan too far ahead.” 

Fable II f. Hercules and the Wagoner. 

Score 0. “Hercules was not kind.” “Hercules was selfish.’* 

Score 2. “Teaches politeness.** “Teaches not to be mean.” “To do as 
yon are told.**. 

Score 3. “The lazy man should get out and try to push the wagon out 
himself.” ' “When you get stuck in the mud, dpii’t call for help, but try 
to get out yourself.” 

Sc*ore 5. “God helps them who help themselves,” “Teaches us to help 
ourselves fyefore we ask others to help us.” “Don’t depend upon others.” 

^For furtlier discussion and samples of scoring, see Tennan and Childs, 
i»p. 135*139. 
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Fable VIL The Fox and the Crow. 

Score 0. ‘The fox wanted the piece of meat." “The crow ought not 
10 have trieil to sing till she had swallowed it.’* 

Score 2. "Not to be stingy." "Not to steal.” "Think before you act." 

Score 3. "The crow was tlattered by this si)e€H h." "The crow was too 
proud of lier voice." "If the crow had not been so flattered, she would 
not iiavc lost her meat." 

Score 5. "Do not let i>eople flatter you." "Don’t listen to praise." 

Fable Vlll. The Farmer and the StorJe. 

Score 0.' "The farmer ought to have let the stork go." "The fanner 
was a bad-tempered man." 

Score 2: "To be merciful.-" "Do not kill animals." "Don’t blame the 
other fellow." "Never go into traps." "Not to tell lie.s." "Take what 
you get without squealing." 

Score 3. "The stork should not be caught with bad peoi>le like cranes." 
"The stork was caught in bad company and had to be treatcil tlie same." 

Score 5. "Keep out of bad company." "You are .ludgtHl by the com 
pany you keep." 

Results. — (1) Xonus. The results obtaiued hy Fal>lcs I, 111, 
VII and VIII applied to about 350 pupils from the 4ih lo tin* 
8th grades, iuclusive, in 14 rooms of the Palo Alto ami May- 
field, Cal., schools firovide representative data for children up 
to 13 years of age. Table 130 shows the i)ercentage of children 
of a given age that secured each of the scores from 0 to 5 lor 
tacli of the four fables. Exiterimeuters can add their own re 
suits to this distribution and thus increase the reliability of 
the di^ributioiis. The data in Table 137 are secured by adding 
together the scores of the four fables {maximal score = 20) ami 
multiplying by 5 to bring to a percentage basis. The last col 
uiun of this table may be taken as a diagnostic basis, as ii 
indicates the score that is reached by two thirds of tlni pui)ils 
of a given age. 

(2) Dcpeudcncc bn (((jc. Tennan believes lliai "what is tested 
by the inter}»retalion of fables is, in ])art at least, tliat geinn'al 
change of mental horizon that comes with increased ev})eiieiue 
and dawning maturity.^’ The data thus far available indicate 
a fairly .sieady increase of proficHeiicy with age, save that per 
formance at 12 does not differ greatly from that at 11 years. 
With these four fables at least there is evi<lently not nuieli 
chance of obtaining distributions for ages le.ss tljan 0; ind(‘(H], 
in the opinion oi Termau and Childs it would he dillieiiU to 
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TABLE 18G 

Distribution by Percentages in Interpretation of Fables (Terman 
and Childs) 







SCORES 


1 

TOTAL 

PERCENTAGE OP 

FABLE 

AGE 

CASES 








INCORRECT 



1 

0 j 

1 

2 

3 

4 

5 

4 + 5 

GENERALIZATIONS 


I. 

‘9 

41 

14 

31 

24 

4 

4 

39 

23 

51 


10 

53 

13 

22 

20 

4 

9 

30 

39 

34 

The Maid 

11 

61 

8 

6 

33 

10 

16 

28 

44 

41 

and 

12 

80 

7 

10 

22 

5 

16 

39 

55 

28 

the Eggs. 

13 

73 

5 

4 

18 

8 

15 

47 

62 

22 


14 

43. 

5 

9 

20 

5 

IG 

38 

54 

27 

III. 

9 

43 

14 

7 

19 

29 

12 

16 

28 

40 


10 

53 

9 

9 

13 

19 

17 

32 

49 

25 

Hercules 

11 

61 

5 

6 

15 

13 

20 

41 

61 

22 

and the 

12 

80 

3 

12 

12 

11 

21 

39 

60 

17 

Wagoner. 

13 

73 

0 

5 

15 

12 

38 

47 

65 

18 


14 

43 

5 

0 

9 

2 

36 

45 

81 

10 

vir. 

9 

41 

19 

27 

34 

14 

2 

i 

2 

4 

90 


10 

. 53 

17 

26 

35 

2 

5 

13 

' 18 

66 

The Fox 

11 

61 

8 

15 

44 

i 8 

8 

16 

24 

65 

and 

12 

80 

11 

17 

32 

6 

15! 

17 

32 

50 

The Crow. 

13 

73 

31 

16 

27 

3 

8 

32 

40 

40 

j 

34 

43 

14 

7 

34 

5 

34 

25 

39 

46 

viir. 

9 

41 

36 

39 

3< 

5 

2 

5 

7 

81 


10 

53 

21 

24! 

24 

2 

4 

24 

28 I 

46 

The Farmer 

11 

61 

16 

Ill 

21! 

6 

11 

331 

44 ! 

32 

and 

12 

80 

15 

15 

22 

5 

7 

33 

40 

35 

the Stork. 

13 

73 

8 

8 

14 

8 

34 

46 

60 

19 


14 

43 

7 

5 

18 

5 

13 

52 

63 

22 


The percentage of incorrect generalizations is obtained by dividing the 
number of Scores 2 by the combined number of Scores 2, 4 and 5 (see 
explanation of scoring given above). 


select any fables that would be serviceable for younger children. 
On the other hand, the addition of a few more diflicult fables 
^Svould make the test especially valuable at the upper end of 
the scale and help a great deal in the difficult task of extending 
the scale beyond 13 years.’^ 

(3) Dependence on intelligence. Swift reports that the table- 
test showed no superiority for the ‘bright^ children ; that, on 
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TABLE 1S7 

Norms for Interpretation of Four Falles {Terman and Childs) 


AGE 

CASES 

MEDIAN 

REACHED BY 

66 o/o 

9 

41 

35-40 

25-30 

10 

53 

45 


11 

61 

50-55 


12 

80 

55 


13 

73 

70 

55-60 

14- 

43 

1 

70-75 

55-60 


the contrary, with the fable of The Fishes and the Pilce, which, 
he says, requires distinctly intellectual process, the dull 
group excelled the bright group, while the answers of bo^s in 
an industrial (reform) school ‘^distinctly outranked those from 
both of the other groups, but especially the ones from the 
‘bright’ division, in the penetration and versatility that they 
showed.’^ 

Terman’s tests showed, on the contrary, that his ‘dull’ group 
was distinctly inferior to his ‘bright’ group, for, as he says: 
“in the first place, they more frequently miss the point of the 
story altogether,” and “in the second place, the dull boys are 
plainly deficient in degree of abstraction. Even when they give 
an approximately correct interpretation, they usually express 
it in the concrete terms of the given situation, instead of gen- 
?ralizing it.” 

This lack of accordance is attributed by Terman to some fault in 
method on the part of Swift. “I should judge,” he says, “that his results 
would have been different if he had been able to take his cases individu- 
ally, instead of collectively.” 

9y way of illustration, the following quantitative results may be 
quoted: Swift reports that, in the fable mentioned, 27% of his ‘bright 
group, as contrasted with 9% of his ‘dulT group, thought the plan wis® 
and just. Again, only 15% of the bright children, as contrasted with 
30% of the dull children, pointed out that the plan would not help the 
fishes that were not turned into pike. When scored according to Ter- 
man’s plan" his bright /8’s averaged for three fables the ranks 1.3, 3.17 
and 2.a3, respectively, while his dull S's averaged the ranks 1.86, 4.57 
and 4.57 for the same three fables. ^ , t m 

Swift states that “the answers from the public-school children lacked 
individuality; they were conventional, while those from the reform 

"In this earlier work Terman gave the score 1 for a satisfactory 
answer, 5 for a complete failure. 
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school gave evidence of spontaneity and resourcefulness,” and be draws 
from this the dubious conclusion that “the question may be seriously 
raised whether the schools do not train children to stupidity.” 

Quite on the contrary, Terman and Childs cite the following replies, tc 
Fable VII given by pupils 13 to 17 years of age, all of whom were 
retarded in school from 2 to 4 years : 

Fahle VIl. 

“The fox was slicker than the crow was.” 

“Not to be generous to people you don’t- know.” 

“Not to sing when you have anything in your mouth.’' 

“To -eat before you sing.” 

“Not to be forgetful.” 

“Where there’s a will there’s a way.” 

“To eat the meat and then sing.” 

“How to be wise.” 

“Don’t answer if your mouth is full.” 

“Look before you leap.” 

“When you have a thing, hang on to it.” 

“She should not have opened her mouth.” 

“Teaches us to look for tricks.” 

“To finish one thing before we do another.” 

“Taught the crow to be wise and not to open her mouth when she had 
anything in it.” 


(4) lieliahility. No statistical constants have been reported 
that might serve as coefTicients of reliability. It may be men- 
tioned, however, that ^^an previous familiarity with the 
fables does not necessarily increase in the least his chance of 
winning a high score.^^ In one room of the Palo Alto schools 
the 35 pupils had read some or all of the test fables, but these 
children made no better scores than others of their age and 
school grade. " Terman and Childs conclude that even had an 
attempt been made to teach the moral of these fables, it would 
not have been successful if the situation in the fable was nat- 
urally beyond the child^s powers of comprehension. 

(5) Correlations. Wyatt reports the following correlations 
with interpretation of fables: analogies .74, completion test 
.69, word-building .47, part-wholes test .56, sentence construc- 
tion .53, memory for nonsense syllables .41, dis.sected pictures 
.26, letter-squares .31. 

Notes. — ^Por other tests that present a certain anal<^ to the 
interpretation of fables, the reader .may see Bonser’s, iikterpre- 
tation of i)oetry (literary interpretation), already mentioned, 
Mrs. Squire’s tests of supplying a suitable name to, or ot usk- 
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ing appropriate questions about a number of pictures, ami 
Abelsou’s test of interpretation of pictures. 
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Tests of Intellectual Equipment 

The tests of this chapter differ from other mental tests de- 
scribed ill the present volume in that they measure, not the 
efficiency -with which certain typical mental activities or mental 
processes can function, but rather the number of ideas that an 
individual possesses. In other words, their purpose is not to 
measure what the individual can do, or how well he can dp it, 
but what he knoAvs about — to take a census, as it Avere, of his 
stock of information. G. Stanley Hall’s study of the content 
of children’s minds on entering schooP is, perhaps, most nearly 
allied in type and conception with the tests Avhich are here 
jfresented. 

The first test is designed to secure an estimate of the number 
of Avords ill the reading vocabulary of the individual tested, 
the second to secure an estimate of the number of subjects 
(disciplines, phases of human activity) Avith which the indi- 
vidual has an exact or an approximate accjuaintance. 

TEST 50 

Size of vocabulary. — Since nearly all thought and expression 
is couched in linguistic form, and since the intellectual progress 
of the child at school is, in a sense, a process of augmentation 
of his vocabulary and of refinement in its use, it seems not un- 
reasonable to assume that the determination of the size of this 
vocabulary Avill be of significance and A^alue in estimating his 
general intellectual status. 

Experiments conducted by Kirkpatrick have shown that an 
approximate determination of AA^hat might be termed the vocaiii- 
lav}/ index can be secured by the use of ^he relatively short and 
simple method that is described hereAvith. By extending the 
scope of the tests, the usual comparatiA^e study may be made, 
and the index may be related to its conditioning factors — age, 
sex, school standing, extent of reading, general ability, etp. 

*See his Aspects of child life and education. Boston, 1907. 

[674] a08 
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Kirkpatrick's original list of word? has been applied by the 
author with some modifications of method. Ternian and Childs 
have prepared an entirely different list, on the ground that the 
words should be selected from a smaller dictionary — one lim- 
ited to representative and more generally employed words and 
not including any large proportion of technical terms. They 
have prepared a list of 100 test-words by taking the last word 
in every Gth column of Laird and Lee^s Vest-Pocket Webster 
Dictionary, 1901 edition. This dictionary contains 18,000 
words, though advertised to contain 30,000, whereas the Web- 
ster's Abridged Dictionary used by Kirkpatrick contains 
28,000 words. 

Material, — ^Two printed vocabulary tests: the Kirkpatrick 
list and the Terman and Childs list (modified by the author in 
respect to instructions for group testing). 

PRELniiNARiES. — 111 accordancc with Kirk])atrick’s plan, 
several })reliminaiy exercises are employed, in order, on the one 
hand, to obtain data with regard to /8’s general familiarity with 
words, his range of reading, etc., and on the other hand, to 
instill in him an attitude of caution in undertaking the vocabu- 
lary-test proper. These preliminaiy exercises are as follows:- 

(1) Ask S to write the opposite of the following terms: goocL 
lo'ng^ hrcalcy rudCy siinpICy permanent y particulaVy permit y ol)noX' 
iouSy genuine. 

(2) Ask S to tell (orally or in writing) what the following 
words mean; ahductory harony channely decemviratey escJiary 
amalgamationy hottle-Jioldcry concatenatCy disentomhy filiformy 
(joiirdy intercedCy matting y page, liodmany lanuginosCy niiiffy plio- 
iograpliy scrolly tycoon. (Where words have more than one 
meaning, all are to be given.) 

(3) Secure from S' a list of all.the papers and magazines that 
he is in the habit of reading, 

(4) Secure from ^ the names of the books that he has read 
during the past G mouths. 

(5) Ask ^ which of ihese books he liked the best, whj' he liked 
it, and to give some account of what it was about. 

=To follow tbe plan, the first two exercises, at least, should be given 
whenever Krade p\ipils are tested, and all five if time permits. 
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(6) Ascertain the birthplace of S’s parents, his school grade, 
and his favorite school subjects. 

Method. — Both tests can be conducted by handing the printed 
forms to 8 and asking him to read the instructions over twice 
and then to mark the words carefully in accordance with them. 
But to secure data that will be directly comparable with those 
published for their test by Terman and Childs the examination 
of S must proceed orally. S sees the word, hears it pronounced 
by E, and then gives its meaning orally. E scores each term 
0, 0.5 or Iv The score 1 is given when is able to give any 
single correct meaning for the word, even if the meaning given 
is not the commonest one and ev^en if the definition be poorly 
expressed. E must err on the side of leniency and make due 
allowance for the difficulty of definition in the case of children. 

The following illustrations will indicate the degree of latitude allowed 
by Teiman and Childs in scoring their test: Full credit (1 point) was 
given for: Afloat — “a ship floats on the water;” civilly — ‘‘it's wlien yon 
treat a person nice;” hysterics — ‘‘you act funny or crazy:” mu jest y — 
“what you say when you are speaking to a king;” copper — “something 
you Uijflxe inonoy out of.” Half credit (0.') point) was given for : sportive — 
“to like sports;” pork — “a kind of meat.” It will be seen that a very 
liberal standard has been used. “Questioning for the sake of drawing 
out meanings was not resorted to except in rare instances to overcome 
the child’s timidity.” 

Treatment of Data. — The Kirkpatrick list supplies E di- 
rectly with the number of words marked ‘plus/ and this number 
indicates the vocabulary-index. For comparison with Kirk- 
patrick’s and Whipple’s norms based on this test, the index, 
taken as a per cent., is multiplied into 28,000. 

The Terman and Childs list, when scored directly by E ui)Oii 
the oral responses of Sy gives a vocabulary-index by the simple 
addition of points scored, and this index, taken as a per cent., 
is multiplied into 18,000 to make direct comparison with the 
absolute size of vocabulary as computed by these authors. 

The Terman and Childs list, when scored by E on a basis of 
S^B own marking (following the authors set of instructions), 
yields font* quantities— ^number of w’ords that can be defined, 
that can be explained, that are roughly familiar and that are 
unknown. The equating of these gradings with the ‘points’ 
used by Terman and Childs may l>e roughly aceompliKhed by 
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regarding each and as indicating one point and each T' 
as indicating a half-point. 

Variations of Method.— To study S’s tendency to overesti- 
mate or underestimate his vocabulary, E may follow the plan 
used by the author with college students, of giving the check- 
definition test after the vocabulary test. 

(1) Give ^ the Kirkpatrick vocabulary test without suggest 
ing that he may be called upon to justify his marking. 

(2) When the marking has been completed, and the slip is 
in E'S hands, submit to /Sf the following list of words, with a re- 
quest that each word be defined. Allow 20 min. for written 
definitions. 

Definition-Lisy." 

abductoi* interOicI ninalgaiuatioii lanugo 

abet itUerini amanuensis lanyard 

baroscope matt»)ck amaranth imifti 

chantiolecr inaturat(‘ liottomry photo-lithograph 

chaos pudgy foucatenate rejoinder 

deceinvirate scruff diseutrance skvsail 

os<‘har scrunch disepalous tendinous 

escheat suheiitaneons disestablish tendril 

eschalot tycoon filiform virago 

goiird tynibal hoecake virescoiu 

(3) For each ascertain from the defiuition-fest : (a) the 

number of words not defined, (h) the number of words wrongly 
defined, (c) Add these to find the total number of words nn- 
known in the list of 40. (d) Consult the vocabulary test-slip 

to see whether any words outside the list of 40 are marked un- 
known.'* (c) Consult the vocabulary-slip again to see whether 
any words thereon are marked doubtful and have not been 
cleared up by the definition-test; consider these as unknown. 
(f) Add all the unknown terras to determine the final connected 
vocabulary"-! ndex, (g) Compare this index witli the index in- 
dicated by S on the vocabulary-slip to see whether S has over- 
or underestimated his vocabulary, and to what degree. 

^Concatenation^ tanuginose and lanuginous, of the vocabulary-test, can, 
of course, be checked off by the definitions given for concatenate and 

lanugo, , . ^ 

*In a test of Sophomores and Juniors in college we were surprised to 
find the following words in this category: harque, barouche, boudoir, ^ 
entomb, filigree, hodman, pagoda, rejuvenate, scroll, sub-let, tenderloin. 
These words, then, it seems, would have to be added to the 40 to secure 
a comprehensive list of possibly unknown words. 
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Eesults. — (1) Kirkpatrick’s computation of the average, 
vocabulary is shown in Table 138. The author’s results, derived 
with Kirkpatrick’s list applied to 70 college students (16 meu 
and 54 women), aged 16 to 25 years, indicate an average vocabu- 
lary of 21,728 when computed on the uncorrected estimates of 
the students, and of 20,512 when computed on the corrections 
supplied by the supplementary definition-test. 


TABLE 138 

Average Vocahiilary in Relation to Scholastic Status {Kirkpatrick) 


SCHOLASTIC STATUS 

VOCABULARY 

SCHOLASTIC STATUS 

VOCABULARY 

Orfidp TT 

4480 

Orndo IN’ 

13.400 

15,640 

Grade III 

6020 

Hifi:h school, 1st year 

Grade IV 

7020 

High school, 2d year 

16,020 

Grade 

7860 

High school, 3d year 

17,600 

Grade VI 

8700 

High school, 4th year 

18,720 

Grade VII 

10,660 

Normal-school pupils. 

19,000 

Grade VIII 

12,000 

College students 

20,120 


The results obtained by Terman and Childs by; the use of 
their list with individual, oral responses from 161 children, 
aged 5 to 13 years, are shown in Table 139. As will be under- 
stood from the explanations already given, the vocabulary- 
index is larger than Kirkpatrick’s, but the absolute vocabulary 
is smaller. 


TABLE 139 

Relation of Vocabulary to Age: Method of Terman and Childs 


MEDIAN 

AGE 

NUMBER 

TESTED 

MEDIAN 

INDEX 

MEDIAN 

VOCAB. 

VOCAB. REACHED 
BY 

66 PER CENT. 

REVISED NORMS 

Ages 

Index 





4 



6.5 

5 

13.9 

2500 

2300 

6 

12 


14 

14.4 

2600 

2300 

V 7 

14 

8.5....,^. 

28 

22.0 

3960 

3600 > 

8 

18 

9.5 

35 

27.8 

5000 

4000 

9 

23 

1 ixtpum 

24 

33.3 

6000 

4500 

10 

26 

1 

29 

33.9 

6100 

5500 

11 

30 

1 ^ mm 

19 

42.9 

7700 

6500 

12 i 

36 


7 

48.9 

8800 

7400 


42 
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The author has used the Ternian and Childs list with 10 mem- 
bers of the George Junior Republic, ages 14 to 18: the aver- 
age index was 53.8 per cent. He has also employed the same 
list by the written response (group method) with Sophomores 
at Cornell University, with the results indicated in Table 14b. 


TABLE 1-10 

V ocalnilaries of Twenty College Students: Tcrman and Childs List 

( Whipple) 



NUMBER 

D 1 

^ 1 

1 ^ 

N ’ 

i ! 

1 ESTIMATED INDEX 

Men 

10 

65.1 

1 20.8 

1 6.7 

7.4 ' 

89.3 

Women 

10 1 

1 j 

56.3 

1 29.2 

1 

1 8.5 ; 

i 

G.O 1 

i 

' 89.8 

i__ 


On the vocabularies of children below the age of G consult 
Whipple (l*i) for the chief studies prior to 190S, and Kovd (4), 
Bush (5), Gheorgov (6) and Heilig (7) for studies subsequent 
to that date. For methods and results of securing vocabularies 
from imbeciles and other feeble-minded consult P>inet^ and 
8inion (3) and Town (11). 

(2) In the author’s clcfiuiiion-testy no word of the 40 was cor- 
rectly defined by every student, and since, as has been noted, 
tliere remained IG other words that were unknown or doubtful, 
it follows that only 44 of the 100 words in Kirkpatrick's list 
were certainly known by every one of 70 college students. 

(3) There is wide individual variation in the size of the 
vocabularies of stlidents of the same age and scholastic status. 


TABLE 141 

Distribution of Corrected Vo abulary hide,r. Seventy College Students 

(Whipple) 


INDEX 

1 

55-59 

60-64 

65-69 

1 

7C-74 

75-79 1 

80-84 85-89 

No. of cases 

1 

1 ! 

1 

1 

G ! 13 j 

! 

i 

19 

] 

0 5 

1 

1 


Highest index, 89%. Average index, 73.26%. Lowest index, 58%. 
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This variation is shown by the distribution in Table 141. The 
lai'gest college-student vocabulary found by the' writer with 
Kirkpatrick^s list is 24,020 (80 per cent.) ; the smallest is 16,240 
(58 per cent.), or approximately the vocabulary assigned by 
Kirkpatrick to the average 2d-year high-school pupil. 

(,4) No positive sex differences have been established, though 
there is a suggestion of superiority of boys over girls, and of 
men over women. 

(5) In general, pupils that read the most books and inaga-' 
zines have the largest vocabularies. 

(6) Kirkpatrick found a tendency toward positive correlation 
between class standing (teachers’ grades) and vocabulary- 
index: ^‘those ranking high in scholarship knew on an average 
about 5 per cent, more words than those ranking low in scholar 
ship.” The author found a more decided correlation (r — 
-f- 0.45, P.E. 0.06) between the index of 58 college students 
and their grades in his classes in educational psychology. 

(7) When no precautionary measures are taken to offset the 
tendency, the determination of the vocabulary-index is com- 
monly affected by overestimation. Inspection of Table 142 will 
show’ that 50 of the 70 college students examined by the author 
overestimated, wdiile but 10 underestimated their vocabulary: 
the largest overestiination was 18 per cent.; the largest 
estiinalion w as 4 per cent, ^iiioe 20, or more than one-quarter 


TABLE 142 

Ovcrcstimation of the Vveahularp Index. Sicvcnfi/ College Htudents 

(Whipple) 


PER CENT. OVERESTIMATED 

NUMBER 

PER CENT. OVERESTIMATED 

NUMBER 

1 

18 

! 1 1 

5 

7 

15 

1 2 

4 

6 

14 

3 1 

3 

7 

13 

1 ! 

2 

10 

12 

3 

1 

9 

11 

1 1 

0 

1 

9 

2 1 

—1 

6 

8 i 

2 ! 

—2 

2 

1 

4 i 

-4 

2 

i 
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of the students overestimated by 5 j/er cent, or move, it is evi* 
dent that, without a somewhat elaborate definition eheck, .the 
reliability of the vocabulary test is distinctly lessened/" 

(8) The definition test reveals an unexpectedly lav^e nund)ev 
of cn’0}ic()us dcfiintioits. The source; of these errors may fro* 
gueiitly be traced to confusion Avith words of similar appear- 
ance or to fancied ctymolo«^ical derivatioi. . The following’ list 
shows tyj)ical errors in definition by college students; the as- 
sumed source of confusion is indicated bv the terms in ])aren- 
theses after the definitions: 

jtnianuonsis — poet laureate, lovinj^ness (aiiiativoness) , 
aniarantli — a precious stone (niuethyst). 

abet — althou.^li (albeit), a \vaj;er (a + bet), (liniiiiish (abate), 
bottomry — the art of bottoiuinr ^‘bairs, deceit, bottom of auythinu:. 
ebaiiticlecr — one who siiu^s a loud sou^lt, one wlio b'ads a ebaiit. 
d('eenn irate — eomi)os( (1 of count out by tens, fovmei-ly a txroup of 
ten men, but any miiuber now. 
diseutrauce— failure to enter. 

dis(‘pal()us — apart from the bead, without should(*rs (di -f e('i»h- 
alousV). 

j?ourd — reward (.i^uerdoii), to slash or whip (j^oad). inorninij: ^;lory. 
int(‘rim — time betwe(‘u two reigns (interregnum), 
lanugo— a kind of language. 

lanyard— yard where leather is tanned (tauyard), yard al)out tlH‘ lane, 
mattock — a lock of hair (matted locks?), a kind ( f lord, a <or( of rug, 
a kind of rol)o (( assock). 
maturate — to rii)eu (mature), to matriculatt\ 
sky-sjiil — a sail in the sky, a kite. 

tycoon — a violent wind (tyi)hoon), an animal, a silk-worm, a natural 
jdienoiucna (sic). 

tendril — a membrane connecting two bono5? (tondou). 
tendinous — capable of endurance (tenacious?). 
scriiiK‘h — a good for nothing person (serng?). 

virago — a kind of bird ( !) (vireo), a disease, giddiness (vertigo), 
virescent — s])ark]ing (iridescent), of or i>ertaining to man ( I) (virile). 

Notes. — (1) The greatest source of unreliability in the vocab- 
ulary lesfs in which >8's mark their own papers lie- m individual 
differences in the subjective standard employed by diilerent 8’?^ 

-’This result may he compared with Kirkpatrick's eonclnsi(>n that very 
young cbildrcn are apt to nndci^(‘stimate because the isolated words of the 
iist fail to arouse associations such as they would if they bad a context. 
Again, wlion Kirkpatrick dc'fined the words of the list to ik rmal-scliool 
students, be found that tlie cn-rors of over- and nnder(‘stimai :>>ii tended to 
cancel one another; while when college classes defined 20 words, 114 of 
24C students (about 40 per cent.) correidlv defined the saim* pi’oportion 
that they had marked as known, and only 7 per cent, errc'd by as much 
as ^ in 20. 
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by the ‘known’-or-^unknown’ method : some mark, as known, 
words wdiich are little more than familiar ; others mark words 
as known only when they can define them accurately. 

(2) This leads one to say again that, especially in the case 
of young cliildren, there may be a tendency toward underesti- 
mation of the vocabulary because isolated words sometimes fail 
to arouse the interpretative meanings that they would arouse 
at once in their customary context. In so far as appeal to the 
ear as well as to the eye is of assistance to young children w hose 
vocabulary is largely auditory, this source of error is partially 
offset by the procedure adopted by Ternian and Childs of read- 
ing the list aloud to them. 

(3) In grading the definition test, it is at times rather ditli- 
cult to decide from the definitions whether aS' does or does not 
know' the meaning of a w’ord wdth sufticient exactness to be cred- 
ited w'ith know ledge of the term in question. In general, it is 
better, in consideration of the difficulty of accurate definition 
and of the short time usually available for this part of the test, 
to err on the side of leniency. 


Thus the following? definitions mi;;ht he fieceptcd : ‘diseslahlisli — to 
overthrow,’ ‘deeeinvirate — a body of ten,’ ‘mattock — a f^ardeii tool/ 
‘amaranth — a fiower wliile the following; ouj?Ijt, in our o])inion, to be 
disallowed: lanyard — ojie of the spars of a siii]),’ ‘deceinvirati' — Roman 
civil officer,’ ‘^ourd — a hollow vessel from which to eat and drink,’ ‘con- 
catenate — to argue,’ ‘baroscope — an instrument for measuring something.’ 

(4) The pamphlet issued by Ayres (1) is of interest as show'- 
ing how few' words, relatively Si)caking, are employed in the 
conduct of ordinary corresi^ondonce. Out of a total of 23,620 
W’orks, taken by the method of random samples from 2,000 let- 
ters, there w*ere only 2,001 different words. 
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TEST 51 

Range of information. — The words that comprise Kirk- 
patrick’s vocabulary test are intentionally selected by cliance: 
some of them, like pngc^ liap];en to be most ordinary and every- 
day terms; others, like Janufjinosc, are nnnsual, tecdinical terms. 
The extent of aS's arajiiaintance with words of tlie latter kind 
deiiends almost entirely iij on tlie nature of liis scliool train- 
ing, or upon the quantity and type of liis general reading. 

The range of information test has l)een devised by the author 
as an extension of the vocabulary test. The hundred test-words 
have been selected, not by chance, hut by careful consideration, 
and in sncl] a manner that eacli shall be rei iesenhitive of some 
specific field of kiiowledue or activity, in the sense that if S has 
made himself familiar with a given field, he will almost cer- 
tainly know the word selected from that field, whereas if he has 
not made himself familiar with the field, he will almost cer- 
tainly not know the term, or at least will not have such knowl- 
edge of it as to enable him to define it exactly. Thus, general 
knowledge of American history is tested by the name Anthony 
Wayne, knowledge of French by aiijouriVImi, of cliemistry by 
chlorine, of ethics by hedonism, of golf by midiron, of socm 
usages by R. S. V. Pv of the technique of photbgraphy by /-6i 
etc. 
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Mateuial. — Specially pi*e]nuvd test-blank* containing 100 test- 
words, directions for marking them, and a request for 10 
definitions. 

Ml:tiiod. — Place the blank in >S’\s hands; ask him to read the 
directions through twice before marking the ^yords, and call 
his attention to the request for delinitions as printed below th(‘ 
test-words. Let him take his own time. 

For exa(‘l results, iS should afterward be required to detint‘ 
every word that he has marked I), and to explain or attempt to 
ex[>lain every word that he has marked E or F. This check' test 
should, by preference, be conducted orally. In practise, how- 
ever, especially when testing by the group method, such careful 
checking may prove too onerous; erroneous definitions may then 
be neglected, or the (luantitative data may be revised by dis 
counting on the basis of the ]>ercentage of error I'evealed in the 
definitions actually given. Or, again, E may, after the test us 
com hided, define the 100 \Voi‘ds, and let each >8' revise his own 
paper by placing a second series of marks after each word lo 
indicate the manner in which lie should have marked it. A com- 
parison of the sums of the />’s, F's, F's and A*s of the first and 
of the second series will then show approximately the extent 
and nature of the error due to ignorance or misunderstanding 
of the real meanings. 

Results. — (1) Dependence on s<hool iraininy. Results ob- 
tained by the author at Cornell University and the Ithaca, 
N. Y., High School, and by Miss Smith at the University of 
Texas are presented in Tables 14:j and 141. In both it is evident 
that advance in school training, together, of course, with 4n- 


TABLE 143 

Dcncndencc of Uunge of Information on AeaiJcmic Status {Whimde) 


ACADEM C STATUS 

NUMBER 

D 

E 

F 

1 

N 

Graduates. 

1 

4 

39.0 

21.0 

! 12.2 

27.0 

Seniors 

5 

20.6 

17.2 

25.2 

37.0 

Juniors 

10 

24.8 

12.0 

23.7 

39.5 

Sophomores- 

30 

17.7 

12.7 

17.3 

52.2 

High School 

52 

6.8 

7.6 

16.8 

69.3 
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creased maturity, is paralleled by an increase in the number 
of technical terms that can be defined (D), explained (E), or 
that are at least familiar (F), and by, naturally, a correspond- 
ing decrease in the number of terms that are new or un- 
known (N). 


TABLE 144 

Dependence of Range of Information on Academic Status (Sniith) 


ACADEMIC STATUS | 

NUMBER 

D 

E 

p 

N 

1 

Graduates ! 

9 

1 

38.11 

12.11 

15.67 

34.11 

Seniors ! 

47 

24.90 

16.70 

: 19.30 

39.10 

.Tnniors 

59 

20.50 

14.40 

20.70 

44.40 

Sophomores 

85 ' 

i 20.10 

12.10 

19.10 

48.70 

Freshmen 

153 

13.70 

10.70 

1 15.50 

1 

60.10 


(2) Dependence on sex. The results obtained at Ithaca ahd 
Austin, reclassified by sex, are shown in Table 145, where it is 
evident that tliere exists a superiority of range of information 
in the males. 


TABLE 145 

Dependence of Range of Information on Sex (Whipple and Smith) 


1 

NUMBER 

D 

E 

^ F 

N 

1 

Ithaca men ! 

Ithaca women... 

Texas men 

Texas women— 

i 

1 

44 

57 

162 

173 

15.79 

12.21 

21.00 

15.20 

1 

11.98 ' 

9.42 
12.70 
13.20 

18.22 ' 
17.19 
15.60 
19.30 

54.02 

61.17 

50.70 

52.30 


(3) The results just figured are ^raw’ results; strictly speak- 
i„g, these should be revised on the basis of an extended senes 
of definitions, as recommended in the Vocabulary Test ( . o. ) , 
since an inspection of the definitions and explanations actually 
given reveals in the majority of the papers one or more errors, 
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due in the main to confusion with words of similar appearance 
or to fancied etymological derivations. The following Ifst 
shows typical errors in definition by college and high-school 
students; the assumed source of confusion is indicated by the 
terms in parenthesis after the definitions: 

ngeratum — an aggregation of objects: the aggragate (sic) amount 
annealed — pressed or rolled out thin: molded together. 

Anthony Wayne — a historic character who was hung in tliQ cause of 
freedom for the blacks : a man who fought in the Kevolution on the 
English side. 

Babcock test — a device to ascertain whether or not cattle have tuber- 
culosis. 

base-hit — when tlie ball is hit and strikes a base or is caught there: a 
ball batted over a base: when the striker bats the ball into the pitcher’s 
hands. 

Bokhara — name of a place in Austria. 

cantilever — a bar with a hook in one end by which lumbermen roll logs 
(cant hook) 

catalepsy — a form of disorder of the nervous system which causes Sts 
or convulsions (ei)ilepsy). (Similar stntenients given by 35 persons.) 

chamfer — the tree from which camphor gum is obtained: this is the 
simplified spelling of it ( !). (The confusion with camphor was found in 
4 papers.) 

clearing-house — a sale that takes place when a store wishes to dispose 
of its sto^'k (clearing sale) : a place where clearing papers are given to 
vessels to enable them to leave the harbor (customs house -f- clearing of 
ve.ssels) : picking up everything to move; taking everything out of a 
house: a place used by expre.ss Companies to sell uncalled-for goods: a 
house where goods are made ready to be delivered. 

cotangent — name of one of two tangents drawn to a circle from the 
same point without the circle: one lying alongside of (contingent): 
straight line drawn to touch a circle at one point (tangent). 

dibble — to get just a smattering of some subject, as to dibble in medi- 
cine or politics (dabble) : to do with divided interest (dawdle), 
dryad — a priest of early English times (druid). 

entree — first course at a banquet, usually soup: something in the way 
of food, new and out of season : when the waiter brings in a new course 
it is called an entre: French for ‘to-day’: French for ‘between’ (eafre). 
Eocene — the term applied to one of the early ages of civilization. 
Euclid— -a book written by Vergil (ASneid) : name given to certain 
trees (eucalyptus) : an ancient Egyptian who studied geometry: name of 
an avenue in Cleveland, Ohio. 

f-G4 — means the temperature is G4 degrees above zero, Fahrenheit, 
f. o. b. — cash on delivery (c. o. d) ; forward on board, 
golden section — the section of the West. most prosperous, 
hydraulic press— a kind of air-pump, rather complicated, operated by 
suction and pressure: a machine for washing dirt from gold or from 
steep slopes (hydraulic mining) : the force with which water flows upon 
or against a thing, as a paddle wheel. 

Impressionism — when a man imitates the looks or actions of another : 
the art of exciting an impression, 
infusoria — a chemical herb (infusion?). 



TEST 51 : UANGE OF INFOUMATION 


[ 087 ] 321 


kilogram — the greatest quantity In the metric system : French measure 
of distance (kilometer) ; French unit of liquid measure: the weight of a 
cube of. water whose dimensions are a kilometer. 

Les Mis^rables — a French tragedy written about the last part of the 
17th century by Racine, one of the famous French writers : French work 
written by George Sand, author of Le Diable. » 

linotype — the product of a certain method of making prints from 
photographs. 

Millet — a blind poet (Milton). 

natural selection — in nature each animal selects ts mate, a device for 
building up a stronger race, 
ohm — German word for uncle (Ohcim). 

Polonius — a prominent character in Julius Caesar, 
pomology — the study of the palm of the hand, used by fortune tellers 
(palmistry). 

tort — French word for ugly (torsf). 

triple expansion— the expanding of anything three times its normal 
size. 

Utopia — a silk factory. 

way-bill— a bill that is being considered. 

Zionism — same as Dowieism. 

(4) A comparison of scores made by IS summer-session 
students, before and after the definition by E of the 100 terms, 
shows the following averages: first marking, D = 20.39, E = 
14.77, F = 18.39, N = 46.44; second marking, D = 19.77, 
,E = 20.22, F = 19.55, N = 40.44. ^ So far as these /S’s are con- 
cerned, then, it appears that at first they had overfestimated 
terms definable and, more particularly, terms unknown. The 
principal effect of F’s explanations was to increase by about 
6 per cent, the number of terms marked as explainable, and to 
decrease by 6 percent, the number of terms marked as unknown. 

Note.— Attention may be. called to the suggestive method 
devised by Franken (1), the purpose of which is to test not so 
much the range of information of pupils, but I’ather the degree 
to which they overestimate their range and the extent to which 
this overestimation may be reduced by proper drill and instruc- 
tion, A series of questions drawn from school work is pro- 
pounded, first in a form that inquires as to the existence of the 
information and that requires merely the answer ‘yes’ or ‘no.’ 
After this series has been answered, the same questions are 
"■iven in a second form that demands a specific answer. Ex- 
amples : first form : “Do you know what city is the capital of 
France”? Second form : “What city is the capital of France”? 
For various ways of conducting tests by these two forms of 
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qiiestious tlie oiigiiuil articles should be consulted. Fraiiken’s 
method is in luan.v features more akin to the ^\ussage^ lest 
(No. 32), 


REFERENCES 

(1) A. Franken, (a) Ueber die Erziebbarkeit der Erimierungsaussago 
bei Scbulkindern. ZPdPs, 1*2: 1911, 0:15-04*2. (h) Aussageversucbe iiacb 
der Metbode der Entscbeldiings- iind Bestiniimingsfrage bei Erwacbsenen 
und Kiiidern. ZAiifiPs, 0: 191*2, 174-253. 

(2) Laura L. Siiiitb, Wbipple's range of information test. PsR, 20: 
1913 517-518 

(3) G. M. Wbipi>le, A range of information test. PsR, 10: 1900, 
347-351. 



CHAPTEF XU I 


Sehial Graded Tests for Devei.opmextal Diagnosis 

The omission, from this volume of the le Sanctis tests and 
of the Binet-Simon tests demands a brief explanation. ■ The 
reasons that have led to this omission are: fii*st, the extension 
of the material of the preceding pages has brought the volume 
to dimensions already in excess of the original plans; se(‘ondly, 
the number of published investigations bearing upon the Binet 
tests is so enormous (Kohs’ bibliography lists 254 titles to June, 
1914) that the proper consideration of so much material de 
mands more time than can be permitted; thirdly, the extensive 
use of the Binet tests has given rise to so many variations in 
method of application and scoring that there now exist numer- 
ous issues upon each one of which an authoritative presentation 
must take a definite and justified stand— something which is 
impossible without extensive comparison of the views of various 
writers and resolution of the contlicting views on the basis of 
careful first-hand investigation; fourthly, there are now avail- 
able a number of pamphlets of directions prepared by compe- 
tent writers (Goddard, Kuhlmann, Schwegler, Ternian, Town^ 
AVinch, et al), so that the need for a Binet handbook that was 
felt when the fii*st edition of this Mamial appeared is now suffi- 
ciently met, and it would be only adding confusion to present 
still another version of the tests if it were set forth without 
sufficient justification to claim attention as a standardized 
version. 

It is my hope, however, to issue later a supplementary ^ol- 
ume that will discuss the rationale of combinations of tests 
into systems, that will deal with the Binet tests in a compre- 
hensive manner, and that will include also other systems of 
tests, such as the de Sanctis tests and the psychological-profile 
method of Kossolimo. In the meantime, the selected references 
that follow will serve to guide the reader to some of the more 
important discussions in English of two of these test-systems. 
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dren measured by the Binet measuring scale of intelligence. PdSc, 18: 
1911, 232-250. (c) Standard method for giving the Binet test. 

10; 1913, 23-30. 
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Measures (English and Metric Systems) 


Fonmulas for Converting 

.V( of Length 

I nnn. 0.0304 iiicli. 

1 < in.- 0.3037 iiidi. 

1 Jii. =3 30.37 iiiclios. 

I in. — 2.7)4 cm. 

I ft.“0.304Sm, 

Pleasures of Surface 
1 Nil. cm. r= 0.17)0 s(j. ill, 

1 S(i. in. — 0.47)2 s<i. cm. 


Mcos-urcs of CupacUg 
1 cn. cm. z=: O.OGl cii. in. 

I cn. ill, — j ).4 eu. cm. 

Measures of Weight 
1 ::i*am =r 0 033 oz. 

1 kff. -- 2.m lbs. 

1 <>z. =: g, 

1 ll>. = 40X09 g. 


APPENDIX II 


List of Abbreviations 

Tlio I’ollowiiijr abbreviations, save for a few additions, arc identical 
Nvith tliosc rccommondod and (‘inploycd in tlie Zeilschrift fih' augewandie 
Psgehologie, V, llcft 5-0, VI, Holt 5-0. 

Am Ant: American Antbropoloj^dst (Lancaster, l*a.). 

Anri fax: Amcri('an Journal of Insanity (Baltimore, iNId. ). 

AmAi^hij: American Journal of Physiology (Boston, Mass.). 

A no! Vs: American Journal of Ps.vchology (Worcester, Mass.). 

AniASci: American Journal of Science (New Haven, Conn.) 

AuPs: L’Aimce iisycliologiqne (Paris). 

AriJsPhg: Arcliiv fiir die gcsainte IMiysiologie dos Mcnschon und der 
Tiere (Bonn). 

ArGsl*s: Archiv fiir die gesainte Psychologie (Leipzig). 

.lrP,v(c).* Arcliives of P.sycliology (New York). 

Arl*s{t): Archives de Psychologii* (deneva, Switzerland). 
fiuAeliogSei : Bulletins dc IWcadeinic' Boynle des Sciences, des Lettres 
et des Beanx-arts de Bedgiipie (Brussels). 
fUriinKIW : Berliner Klinisclu' AVochenschrift (Berlin) 

JJiZh: Biologisclies Zentralldatt (Erlangen). 
jirjl^s: British Journal of IVsychology (Cambridge, England). 
liuSoefU PsEnf : Bulletin de la Sociele libre pour lelude psychologique 
de renfant (Paris). 

(UAumhiaVoufUl: Columbia Contributions to Education (New York). 
Col uniJnaCon Ph Ps : Columbia Contributions to Philosophy and Psychol- 
og.v (New York). 

DMdW: Deutsche Medizinisi'he Wochenschrift (Leipzig). 

J'd: Education (Boston. Mass ). 

IJPd: Die experiinentelle Piidagogik (Leipzig). 

EdPsMon: Educational Psychology Monographs (Baltimore, Md.). 
FsPs: Fortschritte der Psychologie und ihre Anwendungeii (Berlin). 

] nMupSeU gg : International Magazine of School Hygiene (Leipzig). 
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JAntL\st: Journal of the Anthroi>ological Institute of Great BritaiiT 
and Ireland (London), 

JEdPs: The Journal of Educational Psychology (Baltimore, Md.). 
JEPd: Journal of Experimental Pedagogy and Training College Record 
(London). 

JNeMeDts: Journal of Nervous and Mental Disease (New York). 

JPh: Journal of Philosophy, Psychology and Scientific Methods (New 
York). 

JPhg: Journal of Physiology (Cambridge, England). 

JPsA.^th: Journal of Psycho-Asthenics (Faribault, Minn.). , 
l\"eMcDisMon: Nervous and Mental Disease Monograph Series (New 
York). 

PdPsArh: Padagogisch-psychologische Arbeiten (Leipzig). 

PdSc: Pedagogical Seminary (Worcester, Mass.). 

PdIJh: Paedologisch Jaarboek (Antwerp). 

PhR: Philosophical Review (Lancaster, Pa.). 

PhSd: Philosophische Studien (Leipzig). 

PopSciM: Popular Science Monthly (Garrison, N. Y.). 

PsArJj: Psychologische Arbeiten (Leii)zig). 

PsBu: Psychological Bulletin (Lancaster, Pa.). 

PsCl: Psychological Clinic (Philadelphia, Pa.). 

PsMou: Psychological Monographs (Lancaster, Pa.). 

PsR: Psychological Review (Lancaster, Pa.). 

RcpComEd: Report United States Commissioner of Education (Was’ 
ington, D. C.). 

RMdSuissc Revue niedicnle dc la Suisse Romande (Geneva, SwiP 
land). 

RPhF: Revue phiIosophi(iue de la Fraiici? et do rEtrangor (Paris). 
RSci: Revue scientifique (Paris). 

8ci: S(‘iencG (Garrison, N. Y.) 

SdYokPsLab: Studies from tlie Yale ISychological Laboratory. 
EiiiAhPdPs: Saimiilung von Abhaiidlungen aus dem Gebiete der pilda- 
gogi.schen Psychologic iind Physiologic (Berlin). 

TrSc: Tlie Training School (Vineland, N. J.). , 

IJnlonaHdPH: University of Iowa Studies in Psj'chology (Iowa City, 
Iowa). 

ZAngPs: Zcitschrift fiir angewandtc P.sychologie uiul psychologische 
Sammelforschung ( Leipzig) . 

ZBi: Zeitschrift fiir Biologie (Munich). 

ZEPd: Zcitschrift fiir exi)erimentelle Padngogik (Leipzig). 

ZPdPs: Zcitschrift fiir piidagogische P.sychologie und experimentello 
Piidagogik (Leipzig). 

ZPs: Zcitschrift fiir Psychologic (Leipz4g). 

ZficGd: Zeitschrift fiir Sehulgesnndhoitspflego (Hamburg). 



APPENDIX III 

List of Materials 

Numerals refer to test-numbers. Items starred refer to materials that 
are recommended, but not prescribed, or to materie'^ for the conduct of 
alternative or supplementary tests. 

The ^iaterials may be ordered of C. II. Stoelting Company, 3<H7 Carroll 
Ave., Chicago, Illinois, who will quote prices on applicfftion. 


I. SPECIAL APPLIANCES 


Card of objects, Bi net’s, 32 
Counter, mechanical; 36* 

Demoor suggestion blocks, 40* 
Kymograph drum and stand, 42, 43 
Memory apparatus,^ Jastrow's, 38* 
Pendulum, seconds’, 38* 

Pictorial completion test, Healy’s, 
48* 

Pictures ( lithographs) , Hindoos, 
31; Australians, 32; Disputed 


Case, 32; AVashington and 
Sally, 32*; Orphan’s Prayer, 
32* ; card of 13 colored, 38 
Prism, 20-D., 36* 

Seconds clock, 33*, 34*, 35*, 48* 
Suggestion blocks, set of 22, 40 
Warmth illusory, electrical appa- 
ratus for, 44; Guidi’s stove, 41 
Weights, progressive, sel of 15 for 
suggestion, 41 


II. SPECIAL PRINTED FORMS 


Analogies, 3 sets of stimulus cards 
and recording blank, 34A; 
three forms for group tests of 


same, 34A 

Association, 100-word list, 33 *, see 
Analogies, Controlled associa- 
tion and Kent-Rosanofif test 
Completion test, Ebbinghaus’, set 
of 4 forms for, 48 
Computation tests, addition book, 
3.5 addition problems, 
Schulze’s method, 35; addition 
problems, 2-place digits, 35; 
addition problems, 20-place 
.digits, 35 ; multiplication prob- 


lems, 35 A 4 

controlled association 4 ot 

stimulus cards, 20 each, for 
part-whole, genus-species and 
opposites (2 forms) tests, 3 . 
four forms for group tests of 


same, 34 

Fables, set of 8, 49 
Information test, 51 


Ink-blots, set of 20, 45 
Keiit-Rosanoff association test, 
33A ; frequency tables for 
same, 33 A 

"Memory for ideas, 3 test sheets 
(Marble Statue, Cicero and 
Dutch Homestead), 39 
Memory for letter-squares, set of 
10 test-cards and blanks for 


records, 38 ^ * 

Memory for seniences, 2 test sheets 
of 21 sentences each, 38 
Memory-span for digits, set of 4- 
test-cards, 38 . ^ . op . 

[irror-drawing, O-poiiUed star, 3b , 
set of 6 patterns, 36 
entences for completion 46 
ubstitution test-strips ; 

• coverboard with key (I orm 
A)’ 37; test blanks (Form B), 
37- set of 4 test-sheets and 
cardboard key (Form C), 3i 
Vocabulary tests, 2 forms 50 
Vonl-buiUling, 2 forms for, 47 
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III. GENERAL APPLIANCES AND MATERIALS 


Alcohol, denatured, 44 
Cardboard, 36, 37, 42, 43, 46 
Cigarette, 31 
Cloth, soft black, 40, 41 
Cross-section paper, Twled in min.j 
42 

Drawing materials, 42, 43 . 
Gummed letters and figures, Sizes 
5 and 10, 38* 

Lamp, alcohol, 44 


Tramps, four 25-watt tungsten, 44 
Matches, 44 
Metronome, 38 
Mirror, 36 
Stamp, 2-cent, 31 
Stop-watch, preferably split-sec- 
ond, 32-39, 44-48 
Supports, 30 
Thumb-tacks, 36 



REFERENCES SINCE SECOND EDITION 
APPENDIX IV 

One hundred thirty-three additional references since the J915 
Edition are listed below. In connection with the following tests, the 
*‘^|^der should consult the refei enccs referred to by number ; 

Suijpb-mentary references 

2, 133 

27, 28, 32. 104. -15, 123, 132 

4t 27, 76, 82, 91, 94, 128, 132 

•455 3. T2, 22. 26, 27, 32, 40, 46, 56. 57. 58 

59, 61, 63, 64, 66, 80, 90, 91, 96, 104, 
III, 117, 1 18, 123. 124, 130, 132 

II. 30, 66 , 81, 87, 96, 117 

9. 20, 24, 25, 30, 35, 50, 52, 67, 72, 73, 

83* 92. loi, 107, J09, 116, 124 
27, 54, 87, 123, 125 

• 516 3 f I5» 25, 32, 38, 45, 54. 63, 88. 90. 

Vv. 99, III. 131. 132 

1, 3. It. 12, 22, 23, 27, 28, 29, 32, 35. 

41, 42, 49, 59, 61, 77, 85, 86, 90. 96, 
98, 104, 123, 132 

• 587 II. 12, 29, 30, 32, 42, 49. 59. 63, 65, 

66, 96, 97, 98, 104, JJi, ]i^, J30, J32 

31 

31 

104 

32, 84, III 

3. 97. 104 

27, 32, 90, 97, 98, 109, III 

9, 26, 61, 66, 75, 80, 81, 90, 98, too, 

J17, 118, 119 

6, 14, 16, 17, 18, 21, 44, 69, 79. 103. 

1 1 4, 120, 126. 

10, 47, 53, 66, 107, III, 117, 119, 122, 

124 

Note: Additional abbreviations to those listed in Appendix 11: 
JApPs: The Journal of Applied Psychology (Worcester, Mass.) 
JPPs: The Journal of Experimental Psychology t Princeton, 

J*) 

ScSoc: School and Society (Carrisoii, N. Y.) 

references since TPIE SECOND EDITION 

(1) Adams, H. F. A note on the effect of rhythm on memory. 

PsR, 22; 1915, 289-298. , , - 

(2) Adler, Martha. Mental tests used as a basis for tlic cla-sifi 
cation of school children. JEdPs, 5: 1914, 22-28. 

(3) Anderson, H. W., and Hilliard, G. H. The standardization 
of certain mental tests for ten-year-old children. J edPs* 7 • 1916, 

Anderson, Minnie. An investigation into the rate of mental 
association. JEdPs, S : ^617,97-^2. 

3. ( 32o J 


Test 

Page 

32 

. . . 408 . 

33 

. . .419. 

33a 

• • -437. 

34 

■ •455. • 

34a 

. . .460. 

35 

...485.. 

36 

. .499. . 

37 

. .516. . 

38 

• .579. . 

39 

...587.. 

41 

, . . 602 . . 

42 

. . 608 . 

44 

..618.. 

45 

. .626. . 

46 

. . 640 . . 

47 

. .649. . 

48 

..666.. 

50 

. . 683 . . 

51 

. .688. . 
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(5) Baldwin, B. T. A measuring scale for physical growth and 
physiological age. Nat. Soc, Study Bd,, Fifteenth Yearbook, Part i., 
1916, 11-22. 

(6) Bateman, W. G. The language status of three children at 
the same age. PdSe, 23: 1916, 211-240. 

(7) Beeley, A. L. An experimental study in left-handedness^ with 
practical suggestions for schoolroom tests. University of Chicago, 
1918. 69 pages. 

(8) Beik, A. K. Physiological age and school entrance. PdSCf 
20: 1913* 277-321. 

(9) Bell, J. C. Mental tests and college freshmen. JedPs, 7: 

1916, 381-399. 

(ro) Bell, J. C. A detailed study of Whipple's range of infor- 
mation test. JBdPs, 8: I9I7» 475“482. 

(11) Bickersteth, M. E. The application of mental tests to chil- 
dren of various ages. BrJPs^ 9 : 1917. 23-73. 

(12) Bingham, W. V. Some norms of Dartmouth freshmen. 
JBdPs, 7: 1916, 129-142. 

(13) Bond, N. J., and Dearborn, W. E. The auditory memory 
and tactual sensibility of the blind. JBdPs, 8 : 1917. 21-26. 

(14) Boyd, W. The development of a child’s vocabulary. PdSe, 
21 : 1914, 95-124. 

(15) Bradford, C. G. An experiment in association. PsR, 22; 
1915, 279-288. 

(16) Brandenburg, G. C. The language of a three-year-old child. 
PdSe, 22 : 1915, 89-120. 

(17) Brandenburg, G. C. Psychological aspects of language. 
JBdPs, 9: 1918, 313-322. 

(18) Brandenburg, G. C., and Brandenburg, Julia. Language de- 
velopment during the fourth year. PdSe, 23: 1916, 21 1-240. 

(19) Brown, W. Practice in grading and identifying shades of 
gray. PsR, 22: 1915, 5^9-526. 

(20) Burnham, W. H. Orderly association as a condition of 
mental health. PdSe, 20: I9i3» 360-390. 

(21) Bush, A. D. The vocabulary of a three-year old girl. 
PdSe, 21 : 19T4, 125-142. 

(22) Carpenter, D. F. Mental age tests. JBdPs, 4: 1913, 538-544. 

(23) Chamberlain, A. fl. A memory test with school children. 
PsRs, 22: 1915, 71-76. 

(24) Chapman, J. C. A study of initial spurts in the case of 
adding. JBdPs, 6 : 191S. 419-426. 

(25) Chapman, J. C., and Feder, R. B. The effect of external 
incentives on improvement. JBdPs, 8: 1917, 469-474. 

(26) Chassell, Laura M. Tests for originality. JBdPs, 7: 1916. 
317-328. 

(27") Cooke, F. A note on mental tests for normal boys. JApPs, 
2: 1918, 378-380. 

(28) Cornell, C. B. A graduated scale for determining mental 
age. JBdPs, 8: I9i7» 539-550. 

(29) Cowan, Edwina A. An experiment on the influence of 
training on memory. JBdPs, 7 : 1916, 31-38. 

(30) Coy, Genevieve. The mentality of a gifted child. JApPs, 
2: 1918, 299, 307. 

(31) Cummins, R. A. A study of the effect of basket-ball prac- 
tice on motor reaction. PsR, 21 : 1914, 356-369. 
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(32) Cummins, R. A. Individual differences in a normal-school 
class. PsR, 24: 1917, 403-412. 

(33) Dallenbach, K. M. The effect of practice upon visual appre- 
hension in school children. JBdPs, 5: 1914, 321-334; 387-404. 

(34) Dallenbach, K. M. The effect of practice upon visual appre- 
hension in the feeble-minded. JBdPs, lo : 1919, 61-82. 

(35) Davies, G. R. Elements of arithmet' lal ability. jBdPs, 5 : 
1914, 131-140. 

(36) Dawson, j. Measuring the end-produc"^ PdSc, 22: 1915, 
290-295. 

(37) Dearborn, W. E., Anderson, J. E., and Christiansen, A. O. 
Formboard and construction tests of mental ability. JBdPs, 7: 1016, 

445-458. 

(38) Dearborn. W. F., and Brew'er, J. M. Methods and results 
of a class experiment in learning, JBdPs, 9: 1918, 63-82. 

(30) Doll, K. .\. Psychological measurements of thirteen pairs 
of feeble-mitidcd siblings. TrScBu, 15: 45-47- 

(40) Evans, J. K. and Castle, Margaret. The relation of mental 
ability to chronological age, as determined by certain individual 
and group tests. J.dpPs, 2: 1918, 308-322. 

(41) Gates, A. T. Experiments on the relative efficiency of men 
and women in memory and reasoning.^ PsR, 24: 19^7* 139-146. 

(424 Oates, A. T. Correlations of immediate and delayed recall. 
JBdPs, 9: 1918, 489-406. 

(43) Goudge. Mabel. A simplified method of conducting Mc- 
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Distraction, effect of, on computa- 
tion, 475 ; on immediate mem- 
ory, 559 

Division, see Computation 
Dutch Homestead test, see Logical 
memory 

Ebbinghaus test, see Completion 
test 

Environinent, influence of on lists 
of associations, 418 
Epileptics, performance of, in un- 
controlled association, 413 f. ; 
in letter-span test, 564 : in 
logical memory, 583 f. 

Fables, see Interpretation of fables 
Fatigue, effect of, on opposites test, 
452; on computation, 475-482; 
on immediate memory, 552 ; on 
logical memory, 581 1 ; on com- 
pletion test, 659 f. 
Feeble-minded, performance of, in 
association test, 429 1, 433 f. ; 
in part-whole test, 442 ; in 
genus-species test, 444; in op- 
posites test, 451 ; in immediate 
memory, 196 ff., with size- 
weight illusion, 594 f. See 
Epileptics 

Franken’s question-method, 687 f. 

General intelligence, relation of, to 
report, 400; to Kent-Rosanoff 
test, 431 ff. ; to part- whole 
test. 442 ; to opposites test, 
450 f. ; to analogies test, 459 : 
to computation, 471 ; to mirror- 
rawing, 494; to substitution. 
512 ff. ; to immedlkte memor.v. 
560 ff. ; to logical memory, 582 
f. ; to size-weight illusion, 506 : 
to completion test, 661 f. ; t<» 
interpretation of fables, 6Ti» 
ff. ; to vocabulary, 680 
(ieniis-species test, 442 ff. 

(Inidrs method for suggesting 
warmth^ 614 f. 

Ideational type, effect of, on report. 
403 ; on immediate memory. 
557 f. 

Illusion, see Suggestion 
Imagination, tests of, 619-67:; 


Immediate memory, see Memory 
Individual differences, in descrip- 
tion, 379 1; in living analo- 
gies, 459 f. ; in computation. 
469; in work-curve, 476 f. ; in 
mirror-drawing, 490 f. ; in di- 
rective suggestion, 611 ; in ink- 
blot test, 625; In word-build: 
ing, 646; in completion test* 
659 ; in vocabulary, 679 f. 
Information test, 683-688 
Ink-blots, 620-626, 630 
Insane, fidelity of report in, 400; 
free association in, 434; com- 
putation in, 474 

Instructions, effect of, on Kent- 
Rosanoff test, 434 ff. 
Intelligence, see General Intelli- 
gence 

Interpretation, of fables, 606-673; 
of poetry, 672 ; of pictures, 
673 

Invention, see Imagination and 
Stories, invention of 

Kent-Rosanoff method, see Asso- 
ciation uncontrolled (discrete 
method ) 

Learning, tests of, 409 f., 485-516 
Letter s<iuares, method of, 528 ff*. 
Linguistic invention, 026-649 
Liimiann-Wertheimer test, 664 f. 
lyogical memory, 571-587 

.Marble statue test. set‘ Logical 
memory 

.Masselou method, see Sentence for- 
mation 

Material-weight illusion, 597 
Memor.v, tests of, 383, 409 f., 5U;- 
587 : for serial impressions 
( rote memory), 516-570 ; meth- 
ods and material classified. 
517-521; for digits. 521-528: 
for letter squares. 528 ff. ; for 
words, 530-5;^, 554 f. ; for sen- 
tence.s. 535 f., 586; for pictures 
of objects, 536 f. ; for ideas, 
see Logical memory 
Mental ability, see General Intelli- 
gence 

Mental work, see Work curve 
.Meuuiann’s test, see Memory for 
words and Sentence formation 
Mirror-drawing. 485-499 
Mirror-wrltliig, 497 f. 

Missing-digit test. 482 



INDEX or SirnjECTK 


:i35 


Multipllcatlou, see. Computation 
Musical ability, 639 

Negro, see Racial dift'ereuces 
Norms, for Kent-Rosanoff cate- 
gories, 425 f. ; for free associa- 
tion times, 425 f.; for part- 
whole test, 441 ; for genus- 
species test, 443 f. ; for op- 
l>osites test, 448 f. ; for analo- 
gies, 457 f. ; for computation, 
4G8 f. ; for mirror-drawincr. 
489 f. ; for substitution, 504 ft*. ; 
for immediate memory, 537- 
541 : for logical memory, 57d 
f.-; for size- weight illusion, 
593 f. ; for progressive-weight 
test, GOO f. : for progressive- 
line test, 605 f. : for illusion 
of warmth, 617 ; for word- 
building, 644 f. ; for completion 
test, 656 f. ; for interpretation 
of fables, 669; for vocabulary 
678 f. 


Opposites test. 445-458 

Paralytics, hdelity of report in. 

400; see- Insane 
Part-whole test, 438-442 
Perseveration, 427, 435, 533, 567 
Physical condition, effect of, on im- 
mediate memory, 553 
Pictorial completion test, 605 
Picture tests, 393-307 ; see Descrii> 
tion, Report, ^Memory 
Pictures, test of^ titles for, 381 f. 
Practise, effect of, on report, 405 
f. ; on free associations, 431 ; 
on opposites test, 452 ; on com- 
putation, 470 f., 482; on mir- 
ror-drawing, 491-494 ; on sub- 
stitution, 508-512; on imme- 
diate memory, 550 ff. ; on logi- 
cal memory, 580 f. ; on fiize- 
weight illusion, 596; on pro- 
gressive-weight test, 601; on 
completion test, 659 
Precocity, see General intelligence 
Profile method of Rossolimo, 689 
Progressive-line test, 602-608 
Progressive-weight test, 598-601 

Racial differences, in controlled as- 
sociation, 452 ; in substitution, 
506 ff. ; in immediate memory. 


566; in ink-blot test, 625; in 
word-building, 645 
Range of information, see Infor- 
mation test 

Reliability, coefficient of, in oj>- 
posites test, 452; in analogies 
test, 459; in computation test, 
471 f . ; ill mirror-drawing, 496 : 
in immediate memory, 559 ; in 
logical me lory, 582; in- inven- 
tion of stories, 637 ; .in word 
building, 647 f. ; in completion 
test, 663 ; in interpretation of 
fables, 672 

Report, test of, 383-408 
Resistance-wire method, for sug- 
gesting warmth, 613 f. 
Rest-pauses, see Work curve 
Ries’ association test, 453 f. 

School grade, relation of, to op- 
posites test, 4.50; to computU' 
tion, 469 f . ; to ink-blot test. 
(»24 ; to sentence completion, 
634 : to range of information, 

684 f. See General intelligence 
Sense-department, effect of, .on im- 
mediate memory, 555 ff. ; on 
logical inehiory, 580 

Sentence formation, Masselon's 
method. 627-630; Meumann’s 
method, 630 ff. : Burt’s m eth- 
er, 631 f. ; Binet’s method 
(sentence completion), 6.32 ft*. 
Sex-differences, in description. 378: 
in report, 398 f. : in uncon- 
trolled association, 413. 415- 
118 ; in discrete a'^sociation 
test, 430 f. ; in part-whole test. 
442 ; in genus-specie.s tef?t, 444 ; 
in opposites test, 450; in analo- 
gies test, 459 ; in computation, 
469 : in mirror-drawing, 491 f. ; 
in substitution, 506 ; in imme- 
diate memory, .545-550 ; in 
logical memory, 579; in size- 
weight illusion, 595 ; in 
. warmth-illusion, 617: in sen- 
tence coftipletion, 634 ; in word- 
building, 045; in completion 
test. 658 f. : in vocabulary. 
680; in range information. 

685 

size-weight illusion, 590-598 
Social status, relation of, to re- 
port, 400 

Span tests, see Memory . 

Specht’s test, see Computation 
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Spoeilf iplatioh to fKx-nraey in 
oompntivtion* 47:); in mijTor* 
\lm\ving, 4D(» 

i'Star-test, a^i Min‘Ol‘4|i‘^win^» ^ 
>^tl>riesyiu;enUp» of, 634-^8 

Subfi’acOi)!!, fteo Coij^nitatioD 

8u^?|jcstbn, 1>^ §8.7 f., 

402 f. ; of liiie‘lein,'tli«, 
M Ulbsion of warmth', 
, 012*018 ; ^ StJjjgo^tib^ity 

Sbgges^n-b]o(‘ks, ^ee Sfee-wl^jit 
illu'^ion 

iSyinbol-clfefit, s^e Sub'^itiition 
IV^finaaff^ sc^o lD'i»ort 


Xliome, (fevelopment of, 038 f ; 
choice 

Traii^jfer of practis-e, in coinputa* 
tion, 471; in mirror-clrawin^% 
491 ff,| 4n substitution, 509- 
Immedlujte memoir. 
^^bi%4*5^1;HiUogiM memory* 
037 ' ^ 

'IVDOs in doserfpfcjpns, 380 t ; in 
, worlt-ciu‘ve& #0 t ; in logical 
jii^mo^y, 083 i; in ink blot 
test, 025 f. ; in sentence com- 
pletion, 033 t ; in invention of 
stories, 037 f. 

Waiinth, suggestion of, 012-018 

Woiil building, 040-040 

Work-cur\e, analysis of, 475-482 

Vocalmlaiy test, 040, 074-083 






